2023-07-12 05:14:15,494 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 05:14:15,723 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775 2023-07-12 05:14:15,724 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-12 05:14:15,724 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-12 05:14:15,770 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 05:14:15,984 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 05:14:15,985 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297, deleteOnExit=true 2023-07-12 05:14:15,985 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 05:14:15,986 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/test.cache.data in system properties and HBase conf 2023-07-12 05:14:15,987 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 05:14:15,987 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/hadoop.log.dir in system properties and HBase conf 2023-07-12 05:14:15,988 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 05:14:15,988 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 05:14:15,989 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 05:14:16,276 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 05:14:16,280 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 05:14:16,281 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 05:14:16,281 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 05:14:16,281 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 05:14:16,282 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 05:14:16,282 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 05:14:16,282 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 05:14:16,283 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 05:14:16,283 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 05:14:16,283 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/nfs.dump.dir in system properties and HBase conf 2023-07-12 05:14:16,284 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/java.io.tmpdir in system properties and HBase conf 2023-07-12 05:14:16,284 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 05:14:16,284 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 05:14:16,284 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 05:14:16,909 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 05:14:16,913 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 05:14:17,194 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 05:14:17,373 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 05:14:17,388 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 05:14:17,420 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 05:14:17,451 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/java.io.tmpdir/Jetty_localhost_localdomain_36191_hdfs____.p1jiw0/webapp 2023-07-12 05:14:17,597 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:36191 2023-07-12 05:14:17,611 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 05:14:17,611 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 05:14:18,066 WARN [Listener at localhost.localdomain/43005] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 05:14:18,151 WARN [Listener at localhost.localdomain/43005] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 05:14:18,177 WARN [Listener at localhost.localdomain/43005] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 05:14:18,185 INFO [Listener at localhost.localdomain/43005] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 05:14:18,193 INFO [Listener at localhost.localdomain/43005] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/java.io.tmpdir/Jetty_localhost_38913_datanode____.hdmmwz/webapp 2023-07-12 05:14:18,310 INFO [Listener at localhost.localdomain/43005] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38913 2023-07-12 05:14:18,850 WARN [Listener at localhost.localdomain/45169] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 05:14:18,866 WARN [Listener at localhost.localdomain/45169] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 05:14:18,874 WARN [Listener at localhost.localdomain/45169] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 05:14:18,877 INFO [Listener at localhost.localdomain/45169] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 05:14:18,882 INFO [Listener at localhost.localdomain/45169] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/java.io.tmpdir/Jetty_localhost_43035_datanode____9hulne/webapp 2023-07-12 05:14:19,002 INFO [Listener at localhost.localdomain/45169] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43035 2023-07-12 05:14:19,054 WARN [Listener at localhost.localdomain/44167] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 05:14:19,166 WARN [Listener at localhost.localdomain/44167] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 05:14:19,178 WARN [Listener at localhost.localdomain/44167] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 05:14:19,181 INFO [Listener at localhost.localdomain/44167] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 05:14:19,198 INFO [Listener at localhost.localdomain/44167] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/java.io.tmpdir/Jetty_localhost_32987_datanode____qditnk/webapp 2023-07-12 05:14:19,395 INFO [Listener at localhost.localdomain/44167] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32987 2023-07-12 05:14:19,468 WARN [Listener at localhost.localdomain/45981] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 05:14:19,680 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x67d8ea6dc5156350: Processing first storage report for DS-b7f7fecf-d36d-41ec-991a-becabc36fe83 from datanode 4649c173-cae0-4486-adfa-5bc0bbba6d3c 2023-07-12 05:14:19,683 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x67d8ea6dc5156350: from storage DS-b7f7fecf-d36d-41ec-991a-becabc36fe83 node DatanodeRegistration(127.0.0.1:41845, datanodeUuid=4649c173-cae0-4486-adfa-5bc0bbba6d3c, infoPort=46149, infoSecurePort=0, ipcPort=45169, storageInfo=lv=-57;cid=testClusterID;nsid=1757838184;c=1689138856975), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-12 05:14:19,683 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x681f0da0c0ffec33: Processing first storage report for DS-54d6b770-0283-4a88-878d-8984f9b281ce from datanode 42905543-4e60-4b0c-9139-dbca9fbccf02 2023-07-12 05:14:19,683 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x681f0da0c0ffec33: from storage DS-54d6b770-0283-4a88-878d-8984f9b281ce node DatanodeRegistration(127.0.0.1:42269, datanodeUuid=42905543-4e60-4b0c-9139-dbca9fbccf02, infoPort=32877, infoSecurePort=0, ipcPort=44167, storageInfo=lv=-57;cid=testClusterID;nsid=1757838184;c=1689138856975), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 05:14:19,690 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x67d8ea6dc5156350: Processing first storage report for DS-86d7a125-634a-4e4d-82dd-1b5d76af43d0 from datanode 4649c173-cae0-4486-adfa-5bc0bbba6d3c 2023-07-12 05:14:19,690 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x67d8ea6dc5156350: from storage DS-86d7a125-634a-4e4d-82dd-1b5d76af43d0 node DatanodeRegistration(127.0.0.1:41845, datanodeUuid=4649c173-cae0-4486-adfa-5bc0bbba6d3c, infoPort=46149, infoSecurePort=0, ipcPort=45169, storageInfo=lv=-57;cid=testClusterID;nsid=1757838184;c=1689138856975), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 05:14:19,690 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x681f0da0c0ffec33: Processing first storage report for DS-d4134168-7e48-4a38-b77b-28898708d18a from datanode 42905543-4e60-4b0c-9139-dbca9fbccf02 2023-07-12 05:14:19,690 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x681f0da0c0ffec33: from storage DS-d4134168-7e48-4a38-b77b-28898708d18a node DatanodeRegistration(127.0.0.1:42269, datanodeUuid=42905543-4e60-4b0c-9139-dbca9fbccf02, infoPort=32877, infoSecurePort=0, ipcPort=44167, storageInfo=lv=-57;cid=testClusterID;nsid=1757838184;c=1689138856975), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 05:14:19,708 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x46375038531e7dbb: Processing first storage report for DS-00c02957-d07f-458c-8757-00712e2e50b2 from datanode 4ae7fa5e-130a-4fb2-bf9a-3c0c591cda06 2023-07-12 05:14:19,709 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x46375038531e7dbb: from storage DS-00c02957-d07f-458c-8757-00712e2e50b2 node DatanodeRegistration(127.0.0.1:42625, datanodeUuid=4ae7fa5e-130a-4fb2-bf9a-3c0c591cda06, infoPort=35731, infoSecurePort=0, ipcPort=45981, storageInfo=lv=-57;cid=testClusterID;nsid=1757838184;c=1689138856975), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 05:14:19,709 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x46375038531e7dbb: Processing first storage report for DS-50e001cf-b9ac-4479-98a5-6f739619662e from datanode 4ae7fa5e-130a-4fb2-bf9a-3c0c591cda06 2023-07-12 05:14:19,709 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x46375038531e7dbb: from storage DS-50e001cf-b9ac-4479-98a5-6f739619662e node DatanodeRegistration(127.0.0.1:42625, datanodeUuid=4ae7fa5e-130a-4fb2-bf9a-3c0c591cda06, infoPort=35731, infoSecurePort=0, ipcPort=45981, storageInfo=lv=-57;cid=testClusterID;nsid=1757838184;c=1689138856975), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 05:14:19,963 DEBUG [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775 2023-07-12 05:14:20,056 INFO [Listener at localhost.localdomain/45981] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/zookeeper_0, clientPort=53723, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 05:14:20,075 INFO [Listener at localhost.localdomain/45981] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53723 2023-07-12 05:14:20,087 INFO [Listener at localhost.localdomain/45981] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 05:14:20,089 INFO [Listener at localhost.localdomain/45981] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 05:14:20,784 INFO [Listener at localhost.localdomain/45981] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b with version=8 2023-07-12 05:14:20,785 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/hbase-staging 2023-07-12 05:14:21,101 INFO [Listener at localhost.localdomain/45981] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 05:14:21,645 INFO [Listener at localhost.localdomain/45981] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 05:14:21,675 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:21,676 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:21,676 INFO [Listener at localhost.localdomain/45981] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 05:14:21,677 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:21,677 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 05:14:21,823 INFO [Listener at localhost.localdomain/45981] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 05:14:21,900 DEBUG [Listener at localhost.localdomain/45981] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 05:14:22,013 INFO [Listener at localhost.localdomain/45981] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36929 2023-07-12 05:14:22,026 INFO [Listener at localhost.localdomain/45981] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 05:14:22,028 INFO [Listener at localhost.localdomain/45981] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 05:14:22,052 INFO [Listener at localhost.localdomain/45981] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36929 connecting to ZooKeeper ensemble=127.0.0.1:53723 2023-07-12 05:14:22,099 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:369290x0, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 05:14:22,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36929-0x1007f9a0c7d0000 connected 2023-07-12 05:14:22,151 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 05:14:22,152 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 05:14:22,167 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 05:14:22,174 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36929 2023-07-12 05:14:22,175 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36929 2023-07-12 05:14:22,178 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36929 2023-07-12 05:14:22,183 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36929 2023-07-12 05:14:22,186 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36929 2023-07-12 05:14:22,194 INFO [Listener at localhost.localdomain/45981] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b, hbase.cluster.distributed=false 2023-07-12 05:14:22,266 INFO [Listener at localhost.localdomain/45981] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 05:14:22,266 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:22,266 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:22,267 INFO [Listener at localhost.localdomain/45981] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 05:14:22,267 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:22,267 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 05:14:22,273 INFO [Listener at localhost.localdomain/45981] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 05:14:22,277 INFO [Listener at localhost.localdomain/45981] ipc.NettyRpcServer(120): Bind to /148.251.75.209:37993 2023-07-12 05:14:22,280 INFO [Listener at localhost.localdomain/45981] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 05:14:22,288 INFO [Listener at localhost.localdomain/45981] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 05:14:22,290 INFO [Listener at localhost.localdomain/45981] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 05:14:22,293 INFO [Listener at localhost.localdomain/45981] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 05:14:22,295 INFO [Listener at localhost.localdomain/45981] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37993 connecting to ZooKeeper ensemble=127.0.0.1:53723 2023-07-12 05:14:22,302 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:379930x0, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 05:14:22,303 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): regionserver:379930x0, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 05:14:22,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37993-0x1007f9a0c7d0001 connected 2023-07-12 05:14:22,305 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 05:14:22,306 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 05:14:22,310 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37993 2023-07-12 05:14:22,317 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37993 2023-07-12 05:14:22,318 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37993 2023-07-12 05:14:22,322 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37993 2023-07-12 05:14:22,323 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37993 2023-07-12 05:14:22,341 INFO [Listener at localhost.localdomain/45981] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 05:14:22,341 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:22,342 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:22,343 INFO [Listener at localhost.localdomain/45981] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 05:14:22,343 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:22,343 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 05:14:22,343 INFO [Listener at localhost.localdomain/45981] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 05:14:22,348 INFO [Listener at localhost.localdomain/45981] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38155 2023-07-12 05:14:22,349 INFO [Listener at localhost.localdomain/45981] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 05:14:22,355 INFO [Listener at localhost.localdomain/45981] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 05:14:22,356 INFO [Listener at localhost.localdomain/45981] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 05:14:22,359 INFO [Listener at localhost.localdomain/45981] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 05:14:22,364 INFO [Listener at localhost.localdomain/45981] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38155 connecting to ZooKeeper ensemble=127.0.0.1:53723 2023-07-12 05:14:22,369 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:381550x0, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 05:14:22,371 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): regionserver:381550x0, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 05:14:22,372 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): regionserver:381550x0, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 05:14:22,373 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): regionserver:381550x0, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 05:14:22,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38155-0x1007f9a0c7d0002 connected 2023-07-12 05:14:22,380 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38155 2023-07-12 05:14:22,383 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38155 2023-07-12 05:14:22,384 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38155 2023-07-12 05:14:22,389 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38155 2023-07-12 05:14:22,390 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38155 2023-07-12 05:14:22,404 INFO [Listener at localhost.localdomain/45981] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-07-12 05:14:22,404 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:22,404 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:22,405 INFO [Listener at localhost.localdomain/45981] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 05:14:22,405 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 05:14:22,405 INFO [Listener at localhost.localdomain/45981] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 05:14:22,405 INFO [Listener at localhost.localdomain/45981] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 05:14:22,406 INFO [Listener at localhost.localdomain/45981] ipc.NettyRpcServer(120): Bind to /148.251.75.209:40199 2023-07-12 05:14:22,407 INFO [Listener at localhost.localdomain/45981] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 05:14:22,410 INFO [Listener at localhost.localdomain/45981] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 05:14:22,411 INFO [Listener at localhost.localdomain/45981] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 05:14:22,412 INFO [Listener at localhost.localdomain/45981] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 05:14:22,413 INFO [Listener at localhost.localdomain/45981] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40199 connecting to ZooKeeper ensemble=127.0.0.1:53723 2023-07-12 05:14:22,417 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:401990x0, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 05:14:22,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40199-0x1007f9a0c7d0003 connected 2023-07-12 05:14:22,419 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 05:14:22,425 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 05:14:22,427 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 05:14:22,428 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40199 2023-07-12 05:14:22,428 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40199 2023-07-12 05:14:22,431 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40199 2023-07-12 05:14:22,435 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40199 2023-07-12 05:14:22,436 DEBUG [Listener at localhost.localdomain/45981] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40199 2023-07-12 05:14:22,446 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,36929,1689138860936 2023-07-12 05:14:22,460 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 05:14:22,462 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,36929,1689138860936 2023-07-12 05:14:22,494 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 05:14:22,494 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 05:14:22,494 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 05:14:22,494 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 05:14:22,496 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 05:14:22,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 05:14:22,502 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 05:14:22,504 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,36929,1689138860936 from backup master directory 2023-07-12 05:14:22,509 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,36929,1689138860936 2023-07-12 05:14:22,509 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 05:14:22,510 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 05:14:22,511 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,36929,1689138860936 2023-07-12 05:14:22,515 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 05:14:22,517 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 05:14:22,658 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/hbase.id with ID: 0e019e6b-1938-4ccd-8c7f-984956e81171 2023-07-12 05:14:22,721 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 05:14:22,741 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 05:14:22,801 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x63e81915 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:22,835 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d6d7572, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:22,866 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 05:14:22,868 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 05:14:22,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 05:14:22,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 05:14:22,898 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 05:14:22,903 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 05:14:22,905 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 05:14:22,951 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/data/master/store-tmp 2023-07-12 05:14:22,999 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:22,999 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 05:14:22,999 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 05:14:22,999 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 05:14:23,000 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 05:14:23,000 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 05:14:23,000 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 05:14:23,000 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 05:14:23,002 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/WALs/jenkins-hbase20.apache.org,36929,1689138860936 2023-07-12 05:14:23,028 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36929%2C1689138860936, suffix=, logDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/WALs/jenkins-hbase20.apache.org,36929,1689138860936, archiveDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/oldWALs, maxLogs=10 2023-07-12 05:14:23,126 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42269,DS-54d6b770-0283-4a88-878d-8984f9b281ce,DISK] 2023-07-12 05:14:23,126 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42625,DS-00c02957-d07f-458c-8757-00712e2e50b2,DISK] 2023-07-12 05:14:23,126 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41845,DS-b7f7fecf-d36d-41ec-991a-becabc36fe83,DISK] 2023-07-12 05:14:23,137 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 05:14:23,219 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/WALs/jenkins-hbase20.apache.org,36929,1689138860936/jenkins-hbase20.apache.org%2C36929%2C1689138860936.1689138863038 2023-07-12 05:14:23,223 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42269,DS-54d6b770-0283-4a88-878d-8984f9b281ce,DISK], DatanodeInfoWithStorage[127.0.0.1:41845,DS-b7f7fecf-d36d-41ec-991a-becabc36fe83,DISK], DatanodeInfoWithStorage[127.0.0.1:42625,DS-00c02957-d07f-458c-8757-00712e2e50b2,DISK]] 2023-07-12 05:14:23,223 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 05:14:23,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:23,228 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 05:14:23,230 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 05:14:23,325 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 05:14:23,336 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 05:14:23,388 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 05:14:23,410 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:23,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 05:14:23,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 05:14:23,443 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 05:14:23,450 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:14:23,452 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62325024, jitterRate=-0.07128477096557617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:14:23,452 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 05:14:23,454 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 05:14:23,487 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 05:14:23,487 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 05:14:23,491 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 05:14:23,493 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 05:14:23,535 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 41 msec 2023-07-12 05:14:23,535 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 05:14:23,583 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 05:14:23,591 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 05:14:23,619 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 05:14:23,625 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 05:14:23,627 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 05:14:23,634 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 05:14:23,638 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 05:14:23,640 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 05:14:23,642 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 05:14:23,642 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 05:14:23,657 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 05:14:23,662 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 05:14:23,662 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 05:14:23,662 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 05:14:23,662 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 05:14:23,662 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 05:14:23,663 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,36929,1689138860936, sessionid=0x1007f9a0c7d0000, setting cluster-up flag (Was=false) 2023-07-12 05:14:23,677 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 05:14:23,681 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 05:14:23,683 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36929,1689138860936 2023-07-12 05:14:23,687 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 05:14:23,691 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 05:14:23,692 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,36929,1689138860936 2023-07-12 05:14:23,695 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp 2023-07-12 05:14:23,741 INFO [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(951): ClusterId : 0e019e6b-1938-4ccd-8c7f-984956e81171 2023-07-12 05:14:23,741 INFO [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(951): ClusterId : 0e019e6b-1938-4ccd-8c7f-984956e81171 2023-07-12 05:14:23,741 INFO [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(951): ClusterId : 0e019e6b-1938-4ccd-8c7f-984956e81171 2023-07-12 05:14:23,747 DEBUG [RS:2;jenkins-hbase20:40199] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 05:14:23,747 DEBUG [RS:1;jenkins-hbase20:38155] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 05:14:23,747 DEBUG [RS:0;jenkins-hbase20:37993] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 05:14:23,757 DEBUG [RS:1;jenkins-hbase20:38155] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 05:14:23,757 DEBUG [RS:2;jenkins-hbase20:40199] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 05:14:23,757 DEBUG [RS:1;jenkins-hbase20:38155] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 05:14:23,757 DEBUG [RS:0;jenkins-hbase20:37993] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 05:14:23,757 DEBUG [RS:2;jenkins-hbase20:40199] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 05:14:23,757 DEBUG [RS:0;jenkins-hbase20:37993] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 05:14:23,770 DEBUG [RS:2;jenkins-hbase20:40199] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 05:14:23,770 DEBUG [RS:1;jenkins-hbase20:38155] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 05:14:23,770 DEBUG [RS:0;jenkins-hbase20:37993] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 05:14:23,772 DEBUG [RS:2;jenkins-hbase20:40199] zookeeper.ReadOnlyZKClient(139): Connect 0x4791e265 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:23,773 DEBUG [RS:1;jenkins-hbase20:38155] zookeeper.ReadOnlyZKClient(139): Connect 0x708a7286 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:23,773 DEBUG [RS:0;jenkins-hbase20:37993] zookeeper.ReadOnlyZKClient(139): Connect 0x53312b18 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:23,789 DEBUG [RS:1;jenkins-hbase20:38155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@352f77a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:23,790 DEBUG [RS:2;jenkins-hbase20:40199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13d31e65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:23,790 DEBUG [RS:1;jenkins-hbase20:38155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c559a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 05:14:23,790 DEBUG [RS:2;jenkins-hbase20:40199] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f135a8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 05:14:23,791 DEBUG [RS:0;jenkins-hbase20:37993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1633bf1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:23,791 DEBUG [RS:0;jenkins-hbase20:37993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ea67b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 05:14:23,802 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 05:14:23,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:14:23,808 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 05:14:23,813 DEBUG [RS:0;jenkins-hbase20:37993] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:37993 2023-07-12 05:14:23,815 DEBUG [RS:2;jenkins-hbase20:40199] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:40199 2023-07-12 05:14:23,818 INFO [RS:0;jenkins-hbase20:37993] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 05:14:23,818 INFO [RS:2;jenkins-hbase20:40199] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 05:14:23,818 INFO [RS:2;jenkins-hbase20:40199] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 05:14:23,818 INFO [RS:0;jenkins-hbase20:37993] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 05:14:23,819 DEBUG [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 05:14:23,819 DEBUG [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 05:14:23,819 INFO [RS:0;jenkins-hbase20:37993] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:14:23,820 INFO [RS:2;jenkins-hbase20:40199] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:14:23,820 DEBUG [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 05:14:23,820 DEBUG [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 05:14:23,823 INFO [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36929,1689138860936 with isa=jenkins-hbase20.apache.org/148.251.75.209:37993, startcode=1689138862265 2023-07-12 05:14:23,823 INFO [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36929,1689138860936 with isa=jenkins-hbase20.apache.org/148.251.75.209:40199, startcode=1689138862404 2023-07-12 05:14:23,844 DEBUG [RS:0;jenkins-hbase20:37993] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 05:14:23,844 DEBUG [RS:2;jenkins-hbase20:40199] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 05:14:23,846 DEBUG [RS:1;jenkins-hbase20:38155] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:38155 2023-07-12 05:14:23,846 INFO [RS:1;jenkins-hbase20:38155] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 05:14:23,846 INFO [RS:1;jenkins-hbase20:38155] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 05:14:23,846 DEBUG [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 05:14:23,846 INFO [RS:1;jenkins-hbase20:38155] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:14:23,846 DEBUG [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 05:14:23,848 INFO [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36929,1689138860936 with isa=jenkins-hbase20.apache.org/148.251.75.209:38155, startcode=1689138862340 2023-07-12 05:14:23,848 DEBUG [RS:1;jenkins-hbase20:38155] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 05:14:23,915 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44669, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 05:14:23,915 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58641, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 05:14:23,915 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59267, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 05:14:23,919 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 05:14:23,930 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 05:14:23,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 05:14:23,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 05:14:23,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 05:14:23,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-07-12 05:14:23,938 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-07-12 05:14:23,939 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:23,939 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 05:14:23,939 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:23,940 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 05:14:23,943 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36929] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 05:14:23,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689138893947 2023-07-12 05:14:23,951 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 05:14:23,958 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 05:14:23,959 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 05:14:23,966 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 05:14:23,967 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 05:14:23,972 DEBUG [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 05:14:23,982 DEBUG [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 05:14:23,983 WARN [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 05:14:23,982 DEBUG [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 05:14:23,976 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 05:14:23,983 WARN [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 05:14:23,983 WARN [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 05:14:23,984 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 05:14:23,984 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 05:14:23,985 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 05:14:23,986 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:23,988 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 05:14:23,991 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 05:14:23,991 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 05:14:23,995 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 05:14:23,996 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 05:14:24,002 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689138863998,5,FailOnTimeoutGroup] 2023-07-12 05:14:24,004 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689138864003,5,FailOnTimeoutGroup] 2023-07-12 05:14:24,004 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,005 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 05:14:24,006 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,007 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,028 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 05:14:24,029 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 05:14:24,029 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:14:24,063 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:24,066 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 05:14:24,071 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/info 2023-07-12 05:14:24,072 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 05:14:24,073 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:24,073 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 05:14:24,077 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/rep_barrier 2023-07-12 05:14:24,078 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 05:14:24,079 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:24,079 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 05:14:24,082 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/table 2023-07-12 05:14:24,082 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 05:14:24,083 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:24,084 INFO [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36929,1689138860936 with isa=jenkins-hbase20.apache.org/148.251.75.209:38155, startcode=1689138862340 2023-07-12 05:14:24,085 INFO [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36929,1689138860936 with isa=jenkins-hbase20.apache.org/148.251.75.209:40199, startcode=1689138862404 2023-07-12 05:14:24,086 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740 2023-07-12 05:14:24,087 INFO [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,36929,1689138860936 with isa=jenkins-hbase20.apache.org/148.251.75.209:37993, startcode=1689138862265 2023-07-12 05:14:24,088 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740 2023-07-12 05:14:24,093 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36929] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:24,095 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 05:14:24,100 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36929] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:24,101 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 05:14:24,101 DEBUG [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:14:24,103 DEBUG [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:14:24,103 DEBUG [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:43005 2023-07-12 05:14:24,103 DEBUG [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 05:14:24,106 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36929] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:24,103 DEBUG [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:43005 2023-07-12 05:14:24,107 DEBUG [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 05:14:24,109 DEBUG [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:14:24,109 DEBUG [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:43005 2023-07-12 05:14:24,109 DEBUG [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 05:14:24,111 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 05:14:24,113 DEBUG [RS:2;jenkins-hbase20:40199] zookeeper.ZKUtil(162): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:24,113 WARN [RS:2;jenkins-hbase20:40199] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 05:14:24,114 INFO [RS:2;jenkins-hbase20:40199] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 05:14:24,114 DEBUG [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/WALs/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:24,114 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38155,1689138862340] 2023-07-12 05:14:24,114 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,40199,1689138862404] 2023-07-12 05:14:24,115 DEBUG [RS:1;jenkins-hbase20:38155] zookeeper.ZKUtil(162): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:24,114 DEBUG [RS:0;jenkins-hbase20:37993] zookeeper.ZKUtil(162): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:24,116 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,37993,1689138862265] 2023-07-12 05:14:24,116 WARN [RS:1;jenkins-hbase20:38155] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 05:14:24,121 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:14:24,116 WARN [RS:0;jenkins-hbase20:37993] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 05:14:24,122 INFO [RS:1;jenkins-hbase20:38155] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 05:14:24,122 INFO [RS:0;jenkins-hbase20:37993] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 05:14:24,123 DEBUG [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/WALs/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:24,124 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66372531, jitterRate=-0.010972216725349426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 05:14:24,124 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 05:14:24,123 DEBUG [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/WALs/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:24,124 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 05:14:24,124 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 05:14:24,125 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 05:14:24,125 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 05:14:24,125 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 05:14:24,135 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 05:14:24,136 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 05:14:24,146 DEBUG [RS:2;jenkins-hbase20:40199] zookeeper.ZKUtil(162): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:24,146 DEBUG [RS:1;jenkins-hbase20:38155] zookeeper.ZKUtil(162): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:24,146 DEBUG [RS:0;jenkins-hbase20:37993] zookeeper.ZKUtil(162): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:24,147 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 05:14:24,147 DEBUG [RS:1;jenkins-hbase20:38155] zookeeper.ZKUtil(162): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:24,147 DEBUG [RS:0;jenkins-hbase20:37993] zookeeper.ZKUtil(162): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:24,147 DEBUG [RS:2;jenkins-hbase20:40199] zookeeper.ZKUtil(162): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:24,147 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 05:14:24,147 DEBUG [RS:0;jenkins-hbase20:37993] zookeeper.ZKUtil(162): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:24,147 DEBUG [RS:1;jenkins-hbase20:38155] zookeeper.ZKUtil(162): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:24,148 DEBUG [RS:2;jenkins-hbase20:40199] zookeeper.ZKUtil(162): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:24,159 DEBUG [RS:2;jenkins-hbase20:40199] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 05:14:24,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 05:14:24,159 DEBUG [RS:1;jenkins-hbase20:38155] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 05:14:24,159 DEBUG [RS:0;jenkins-hbase20:37993] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 05:14:24,169 INFO [RS:0;jenkins-hbase20:37993] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 05:14:24,170 INFO [RS:2;jenkins-hbase20:40199] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 05:14:24,170 INFO [RS:1;jenkins-hbase20:38155] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 05:14:24,176 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 05:14:24,180 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 05:14:24,198 INFO [RS:1;jenkins-hbase20:38155] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 05:14:24,198 INFO [RS:2;jenkins-hbase20:40199] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 05:14:24,199 INFO [RS:0;jenkins-hbase20:37993] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 05:14:24,203 INFO [RS:2;jenkins-hbase20:40199] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 05:14:24,203 INFO [RS:1;jenkins-hbase20:38155] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 05:14:24,204 INFO [RS:2;jenkins-hbase20:40199] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,203 INFO [RS:0;jenkins-hbase20:37993] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 05:14:24,204 INFO [RS:1;jenkins-hbase20:38155] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,205 INFO [RS:0;jenkins-hbase20:37993] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,206 INFO [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 05:14:24,206 INFO [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 05:14:24,206 INFO [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 05:14:24,216 INFO [RS:0;jenkins-hbase20:37993] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,216 INFO [RS:2;jenkins-hbase20:40199] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,216 INFO [RS:1;jenkins-hbase20:38155] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,216 DEBUG [RS:0;jenkins-hbase20:37993] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,216 DEBUG [RS:2;jenkins-hbase20:40199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,217 DEBUG [RS:0;jenkins-hbase20:37993] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,217 DEBUG [RS:2;jenkins-hbase20:40199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,217 DEBUG [RS:0;jenkins-hbase20:37993] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,217 DEBUG [RS:1;jenkins-hbase20:38155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,217 DEBUG [RS:0;jenkins-hbase20:37993] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,217 DEBUG [RS:1;jenkins-hbase20:38155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,217 DEBUG [RS:2;jenkins-hbase20:40199] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,217 DEBUG [RS:1;jenkins-hbase20:38155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,217 DEBUG [RS:0;jenkins-hbase20:37993] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,218 DEBUG [RS:1;jenkins-hbase20:38155] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,218 DEBUG [RS:2;jenkins-hbase20:40199] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,218 DEBUG [RS:1;jenkins-hbase20:38155] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,218 DEBUG [RS:2;jenkins-hbase20:40199] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,218 DEBUG [RS:1;jenkins-hbase20:38155] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 05:14:24,218 DEBUG [RS:0;jenkins-hbase20:37993] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 05:14:24,218 DEBUG [RS:1;jenkins-hbase20:38155] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,218 DEBUG [RS:2;jenkins-hbase20:40199] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-07-12 05:14:24,218 DEBUG [RS:1;jenkins-hbase20:38155] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,218 DEBUG [RS:0;jenkins-hbase20:37993] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,218 DEBUG [RS:1;jenkins-hbase20:38155] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,218 DEBUG [RS:2;jenkins-hbase20:40199] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,219 DEBUG [RS:1;jenkins-hbase20:38155] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,219 DEBUG [RS:0;jenkins-hbase20:37993] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,219 DEBUG [RS:2;jenkins-hbase20:40199] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,219 DEBUG [RS:0;jenkins-hbase20:37993] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,219 DEBUG [RS:2;jenkins-hbase20:40199] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,219 DEBUG [RS:0;jenkins-hbase20:37993] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,219 DEBUG [RS:2;jenkins-hbase20:40199] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-07-12 05:14:24,228 INFO [RS:2;jenkins-hbase20:40199] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,228 INFO [RS:2;jenkins-hbase20:40199] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,228 INFO [RS:2;jenkins-hbase20:40199] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,229 INFO [RS:1;jenkins-hbase20:38155] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,229 INFO [RS:1;jenkins-hbase20:38155] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,229 INFO [RS:0;jenkins-hbase20:37993] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,229 INFO [RS:1;jenkins-hbase20:38155] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,229 INFO [RS:0;jenkins-hbase20:37993] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,229 INFO [RS:0;jenkins-hbase20:37993] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,245 INFO [RS:1;jenkins-hbase20:38155] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 05:14:24,246 INFO [RS:0;jenkins-hbase20:37993] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 05:14:24,247 INFO [RS:2;jenkins-hbase20:40199] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 05:14:24,249 INFO [RS:1;jenkins-hbase20:38155] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38155,1689138862340-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,249 INFO [RS:2;jenkins-hbase20:40199] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40199,1689138862404-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,249 INFO [RS:0;jenkins-hbase20:37993] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37993,1689138862265-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:24,284 INFO [RS:1;jenkins-hbase20:38155] regionserver.Replication(203): jenkins-hbase20.apache.org,38155,1689138862340 started 2023-07-12 05:14:24,284 INFO [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,38155,1689138862340, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38155, sessionid=0x1007f9a0c7d0002 2023-07-12 05:14:24,284 INFO [RS:0;jenkins-hbase20:37993] regionserver.Replication(203): jenkins-hbase20.apache.org,37993,1689138862265 started 2023-07-12 05:14:24,284 INFO [RS:2;jenkins-hbase20:40199] regionserver.Replication(203): jenkins-hbase20.apache.org,40199,1689138862404 started 2023-07-12 05:14:24,284 INFO [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,37993,1689138862265, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:37993, sessionid=0x1007f9a0c7d0001 2023-07-12 05:14:24,284 DEBUG [RS:1;jenkins-hbase20:38155] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 05:14:24,284 INFO [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,40199,1689138862404, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:40199, sessionid=0x1007f9a0c7d0003 2023-07-12 05:14:24,285 DEBUG [RS:1;jenkins-hbase20:38155] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:24,285 DEBUG [RS:2;jenkins-hbase20:40199] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 05:14:24,285 DEBUG [RS:1;jenkins-hbase20:38155] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38155,1689138862340' 2023-07-12 05:14:24,285 DEBUG [RS:0;jenkins-hbase20:37993] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 05:14:24,286 DEBUG [RS:0;jenkins-hbase20:37993] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:24,286 DEBUG [RS:1;jenkins-hbase20:38155] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 05:14:24,285 DEBUG [RS:2;jenkins-hbase20:40199] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:24,286 DEBUG [RS:2;jenkins-hbase20:40199] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,40199,1689138862404' 2023-07-12 05:14:24,287 DEBUG [RS:2;jenkins-hbase20:40199] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 05:14:24,286 DEBUG [RS:0;jenkins-hbase20:37993] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37993,1689138862265' 2023-07-12 05:14:24,287 DEBUG [RS:0;jenkins-hbase20:37993] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 05:14:24,287 DEBUG [RS:1;jenkins-hbase20:38155] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 05:14:24,287 DEBUG [RS:2;jenkins-hbase20:40199] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 05:14:24,287 DEBUG [RS:0;jenkins-hbase20:37993] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 05:14:24,287 DEBUG [RS:1;jenkins-hbase20:38155] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 05:14:24,288 DEBUG [RS:1;jenkins-hbase20:38155] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 05:14:24,288 DEBUG [RS:2;jenkins-hbase20:40199] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 05:14:24,288 DEBUG [RS:1;jenkins-hbase20:38155] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:24,288 DEBUG [RS:2;jenkins-hbase20:40199] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 05:14:24,288 DEBUG [RS:0;jenkins-hbase20:37993] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 05:14:24,288 DEBUG [RS:2;jenkins-hbase20:40199] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:24,288 DEBUG [RS:1;jenkins-hbase20:38155] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38155,1689138862340' 2023-07-12 05:14:24,289 DEBUG [RS:2;jenkins-hbase20:40199] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,40199,1689138862404' 2023-07-12 05:14:24,289 DEBUG [RS:2;jenkins-hbase20:40199] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:24,288 DEBUG [RS:0;jenkins-hbase20:37993] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 05:14:24,289 DEBUG [RS:1;jenkins-hbase20:38155] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:24,289 DEBUG [RS:0;jenkins-hbase20:37993] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:24,289 DEBUG [RS:0;jenkins-hbase20:37993] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37993,1689138862265' 2023-07-12 05:14:24,289 DEBUG [RS:0;jenkins-hbase20:37993] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:24,289 DEBUG [RS:2;jenkins-hbase20:40199] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:24,290 DEBUG [RS:1;jenkins-hbase20:38155] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:24,290 DEBUG [RS:0;jenkins-hbase20:37993] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:24,290 DEBUG [RS:2;jenkins-hbase20:40199] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 05:14:24,290 DEBUG [RS:1;jenkins-hbase20:38155] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 05:14:24,290 INFO [RS:2;jenkins-hbase20:40199] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 05:14:24,290 INFO [RS:1;jenkins-hbase20:38155] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 05:14:24,291 INFO [RS:2;jenkins-hbase20:40199] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 05:14:24,291 INFO [RS:1;jenkins-hbase20:38155] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 05:14:24,291 DEBUG [RS:0;jenkins-hbase20:37993] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 05:14:24,291 INFO [RS:0;jenkins-hbase20:37993] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 05:14:24,291 INFO [RS:0;jenkins-hbase20:37993] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 05:14:24,332 DEBUG [jenkins-hbase20:36929] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 05:14:24,337 DEBUG [jenkins-hbase20:36929] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 05:14:24,342 DEBUG [jenkins-hbase20:36929] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 05:14:24,343 DEBUG [jenkins-hbase20:36929] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 05:14:24,343 DEBUG [jenkins-hbase20:36929] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 05:14:24,343 DEBUG [jenkins-hbase20:36929] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 05:14:24,345 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,40199,1689138862404, state=OPENING 2023-07-12 05:14:24,351 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 05:14:24,353 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 05:14:24,353 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 05:14:24,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,40199,1689138862404}] 2023-07-12 05:14:24,406 INFO [RS:1;jenkins-hbase20:38155] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38155%2C1689138862340, suffix=, logDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/WALs/jenkins-hbase20.apache.org,38155,1689138862340, archiveDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/oldWALs, maxLogs=32 2023-07-12 05:14:24,406 INFO [RS:0;jenkins-hbase20:37993] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37993%2C1689138862265, suffix=, logDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/WALs/jenkins-hbase20.apache.org,37993,1689138862265, archiveDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/oldWALs, maxLogs=32 2023-07-12 05:14:24,406 INFO [RS:2;jenkins-hbase20:40199] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40199%2C1689138862404, suffix=, logDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/WALs/jenkins-hbase20.apache.org,40199,1689138862404, archiveDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/oldWALs, maxLogs=32 2023-07-12 05:14:24,453 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42269,DS-54d6b770-0283-4a88-878d-8984f9b281ce,DISK] 2023-07-12 05:14:24,454 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42625,DS-00c02957-d07f-458c-8757-00712e2e50b2,DISK] 2023-07-12 05:14:24,456 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41845,DS-b7f7fecf-d36d-41ec-991a-becabc36fe83,DISK] 2023-07-12 05:14:24,468 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42269,DS-54d6b770-0283-4a88-878d-8984f9b281ce,DISK] 2023-07-12 05:14:24,468 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42625,DS-00c02957-d07f-458c-8757-00712e2e50b2,DISK] 2023-07-12 05:14:24,469 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41845,DS-b7f7fecf-d36d-41ec-991a-becabc36fe83,DISK] 2023-07-12 05:14:24,482 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41845,DS-b7f7fecf-d36d-41ec-991a-becabc36fe83,DISK] 2023-07-12 05:14:24,482 INFO [RS:2;jenkins-hbase20:40199] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/WALs/jenkins-hbase20.apache.org,40199,1689138862404/jenkins-hbase20.apache.org%2C40199%2C1689138862404.1689138864416 2023-07-12 05:14:24,484 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42625,DS-00c02957-d07f-458c-8757-00712e2e50b2,DISK] 2023-07-12 05:14:24,484 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42269,DS-54d6b770-0283-4a88-878d-8984f9b281ce,DISK] 2023-07-12 05:14:24,486 DEBUG [RS:2;jenkins-hbase20:40199] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42269,DS-54d6b770-0283-4a88-878d-8984f9b281ce,DISK], DatanodeInfoWithStorage[127.0.0.1:42625,DS-00c02957-d07f-458c-8757-00712e2e50b2,DISK], DatanodeInfoWithStorage[127.0.0.1:41845,DS-b7f7fecf-d36d-41ec-991a-becabc36fe83,DISK]] 2023-07-12 05:14:24,501 INFO [RS:1;jenkins-hbase20:38155] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/WALs/jenkins-hbase20.apache.org,38155,1689138862340/jenkins-hbase20.apache.org%2C38155%2C1689138862340.1689138864415 2023-07-12 05:14:24,508 DEBUG [RS:1;jenkins-hbase20:38155] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42625,DS-00c02957-d07f-458c-8757-00712e2e50b2,DISK], DatanodeInfoWithStorage[127.0.0.1:41845,DS-b7f7fecf-d36d-41ec-991a-becabc36fe83,DISK], DatanodeInfoWithStorage[127.0.0.1:42269,DS-54d6b770-0283-4a88-878d-8984f9b281ce,DISK]] 2023-07-12 05:14:24,518 INFO [RS:0;jenkins-hbase20:37993] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/WALs/jenkins-hbase20.apache.org,37993,1689138862265/jenkins-hbase20.apache.org%2C37993%2C1689138862265.1689138864416 2023-07-12 05:14:24,526 DEBUG [RS:0;jenkins-hbase20:37993] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41845,DS-b7f7fecf-d36d-41ec-991a-becabc36fe83,DISK], DatanodeInfoWithStorage[127.0.0.1:42625,DS-00c02957-d07f-458c-8757-00712e2e50b2,DISK], DatanodeInfoWithStorage[127.0.0.1:42269,DS-54d6b770-0283-4a88-878d-8984f9b281ce,DISK]] 2023-07-12 05:14:24,559 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:24,564 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 05:14:24,569 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 05:14:24,588 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 05:14:24,588 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 05:14:24,593 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40199%2C1689138862404.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/WALs/jenkins-hbase20.apache.org,40199,1689138862404, archiveDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/oldWALs, maxLogs=32 2023-07-12 05:14:24,620 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42625,DS-00c02957-d07f-458c-8757-00712e2e50b2,DISK] 2023-07-12 05:14:24,637 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42269,DS-54d6b770-0283-4a88-878d-8984f9b281ce,DISK] 2023-07-12 05:14:24,637 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41845,DS-b7f7fecf-d36d-41ec-991a-becabc36fe83,DISK] 2023-07-12 05:14:24,664 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/WALs/jenkins-hbase20.apache.org,40199,1689138862404/jenkins-hbase20.apache.org%2C40199%2C1689138862404.meta.1689138864595.meta 2023-07-12 05:14:24,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42625,DS-00c02957-d07f-458c-8757-00712e2e50b2,DISK], DatanodeInfoWithStorage[127.0.0.1:41845,DS-b7f7fecf-d36d-41ec-991a-becabc36fe83,DISK], DatanodeInfoWithStorage[127.0.0.1:42269,DS-54d6b770-0283-4a88-878d-8984f9b281ce,DISK]] 2023-07-12 05:14:24,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 05:14:24,666 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 05:14:24,668 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:14:24,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 05:14:24,672 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 05:14:24,674 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 05:14:24,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 05:14:24,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:24,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 05:14:24,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 05:14:24,697 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 05:14:24,700 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/info 2023-07-12 05:14:24,700 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/info 2023-07-12 05:14:24,701 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 05:14:24,702 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:24,703 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 05:14:24,705 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/rep_barrier 2023-07-12 05:14:24,706 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/rep_barrier 2023-07-12 05:14:24,706 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 05:14:24,708 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:24,708 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 05:14:24,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/table 2023-07-12 05:14:24,711 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/table 2023-07-12 05:14:24,711 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 05:14:24,713 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:24,715 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740 2023-07-12 05:14:24,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740 2023-07-12 05:14:24,726 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 05:14:24,729 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 05:14:24,731 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60972886, jitterRate=-0.09143319725990295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 05:14:24,737 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 05:14:24,754 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689138864550 2023-07-12 05:14:24,787 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 05:14:24,793 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,40199,1689138862404, state=OPEN 2023-07-12 05:14:24,793 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 05:14:24,797 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 05:14:24,797 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 05:14:24,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 05:14:24,806 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,40199,1689138862404 in 441 msec 2023-07-12 05:14:24,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 05:14:24,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 648 msec 2023-07-12 05:14:24,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0050 sec 2023-07-12 05:14:24,825 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689138864824, completionTime=-1 2023-07-12 05:14:24,825 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 05:14:24,825 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 05:14:24,934 DEBUG [hconnection-0x2f27a234-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:24,938 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:24,970 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 05:14:24,970 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689138924970 2023-07-12 05:14:24,970 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689138984970 2023-07-12 05:14:24,970 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 145 msec 2023-07-12 05:14:25,015 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36929,1689138860936-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:25,018 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36929,1689138860936-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:25,018 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36929,1689138860936-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:25,023 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:36929, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:25,026 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 05:14:25,037 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 05:14:25,046 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 05:14:25,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 05:14:25,059 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 05:14:25,063 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 05:14:25,068 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 05:14:25,101 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1 2023-07-12 05:14:25,104 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1 empty. 2023-07-12 05:14:25,105 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1 2023-07-12 05:14:25,105 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 05:14:25,152 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 05:14:25,154 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 70d56ac09924781810caf6b6596b7de1, NAME => 'hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:14:25,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:25,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 70d56ac09924781810caf6b6596b7de1, disabling compactions & flushes 2023-07-12 05:14:25,182 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:14:25,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:14:25,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. after waiting 0 ms 2023-07-12 05:14:25,182 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:14:25,182 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:14:25,183 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 70d56ac09924781810caf6b6596b7de1: 2023-07-12 05:14:25,188 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 05:14:25,205 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689138865192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138865192"}]},"ts":"1689138865192"} 2023-07-12 05:14:25,235 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 05:14:25,238 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 05:14:25,244 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138865238"}]},"ts":"1689138865238"} 2023-07-12 05:14:25,249 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 05:14:25,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 05:14:25,254 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 05:14:25,255 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 05:14:25,255 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 05:14:25,255 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 05:14:25,258 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=70d56ac09924781810caf6b6596b7de1, ASSIGN}] 2023-07-12 05:14:25,263 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=70d56ac09924781810caf6b6596b7de1, ASSIGN 2023-07-12 05:14:25,265 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=70d56ac09924781810caf6b6596b7de1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38155,1689138862340; forceNewPlan=false, retain=false 2023-07-12 05:14:25,417 INFO [jenkins-hbase20:36929] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 05:14:25,418 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=70d56ac09924781810caf6b6596b7de1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:25,418 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689138865418"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138865418"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138865418"}]},"ts":"1689138865418"} 2023-07-12 05:14:25,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 70d56ac09924781810caf6b6596b7de1, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:14:25,577 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:25,577 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 05:14:25,581 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 05:14:25,588 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:14:25,589 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 70d56ac09924781810caf6b6596b7de1, NAME => 'hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1.', STARTKEY => '', ENDKEY => ''} 2023-07-12 05:14:25,589 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. service=AccessControlService 2023-07-12 05:14:25,590 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:14:25,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 70d56ac09924781810caf6b6596b7de1 2023-07-12 05:14:25,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:25,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 70d56ac09924781810caf6b6596b7de1 2023-07-12 05:14:25,591 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 70d56ac09924781810caf6b6596b7de1 2023-07-12 05:14:25,593 INFO [StoreOpener-70d56ac09924781810caf6b6596b7de1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 70d56ac09924781810caf6b6596b7de1 2023-07-12 05:14:25,595 DEBUG [StoreOpener-70d56ac09924781810caf6b6596b7de1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1/info 2023-07-12 05:14:25,595 DEBUG [StoreOpener-70d56ac09924781810caf6b6596b7de1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1/info 2023-07-12 05:14:25,595 INFO [StoreOpener-70d56ac09924781810caf6b6596b7de1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70d56ac09924781810caf6b6596b7de1 columnFamilyName info 2023-07-12 05:14:25,596 INFO [StoreOpener-70d56ac09924781810caf6b6596b7de1-1] regionserver.HStore(310): Store=70d56ac09924781810caf6b6596b7de1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:25,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1 2023-07-12 05:14:25,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1 2023-07-12 05:14:25,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 70d56ac09924781810caf6b6596b7de1 2023-07-12 05:14:25,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:14:25,610 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 70d56ac09924781810caf6b6596b7de1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69625749, jitterRate=0.03750450909137726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:14:25,610 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 70d56ac09924781810caf6b6596b7de1: 2023-07-12 05:14:25,612 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1., pid=6, masterSystemTime=1689138865577 2023-07-12 05:14:25,618 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:14:25,618 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:14:25,620 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=70d56ac09924781810caf6b6596b7de1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:25,620 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689138865619"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138865619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138865619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138865619"}]},"ts":"1689138865619"} 2023-07-12 05:14:25,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 05:14:25,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 70d56ac09924781810caf6b6596b7de1, server=jenkins-hbase20.apache.org,38155,1689138862340 in 201 msec 2023-07-12 05:14:25,630 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 05:14:25,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=70d56ac09924781810caf6b6596b7de1, ASSIGN in 368 msec 2023-07-12 05:14:25,632 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 05:14:25,632 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138865632"}]},"ts":"1689138865632"} 2023-07-12 05:14:25,634 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 05:14:25,637 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 05:14:25,640 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 588 msec 2023-07-12 05:14:25,662 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 05:14:25,664 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 05:14:25,664 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 05:14:25,687 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:25,691 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:25,709 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 05:14:25,761 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 05:14:25,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 68 msec 2023-07-12 05:14:25,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 05:14:25,789 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 05:14:25,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-12 05:14:25,813 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 05:14:25,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 05:14:25,817 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.306sec 2023-07-12 05:14:25,820 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 05:14:25,822 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 05:14:25,822 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 05:14:25,824 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36929,1689138860936-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 05:14:25,825 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36929,1689138860936-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 05:14:25,846 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 05:14:25,848 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 05:14:25,851 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 05:14:25,855 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 05:14:25,856 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 05:14:25,862 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7 2023-07-12 05:14:25,862 DEBUG [Listener at localhost.localdomain/45981] zookeeper.ReadOnlyZKClient(139): Connect 0x68a122c8 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:25,863 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7 empty. 2023-07-12 05:14:25,866 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 05:14:25,866 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7 2023-07-12 05:14:25,867 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 05:14:25,883 DEBUG [Listener at localhost.localdomain/45981] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@385825f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:25,911 DEBUG [hconnection-0x29eb03d4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:25,913 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 05:14:25,917 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ab90c6aa8d038fa91b29a25a1b6725f7, NAME => 'hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:14:25,933 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:25,936 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,36929,1689138860936 2023-07-12 05:14:25,938 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 05:14:25,939 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/test.cache.data in system properties and HBase conf 2023-07-12 05:14:25,939 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 05:14:25,939 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/hadoop.log.dir in system properties and HBase conf 2023-07-12 05:14:25,939 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 05:14:25,939 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 05:14:25,939 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 05:14:25,939 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 05:14:25,939 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 05:14:25,940 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 05:14:25,940 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 05:14:25,940 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 05:14:25,940 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 05:14:25,940 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 05:14:25,940 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 05:14:25,940 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 05:14:25,940 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/nfs.dump.dir in system properties and HBase conf 2023-07-12 05:14:25,940 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/java.io.tmpdir in system properties and HBase conf 2023-07-12 05:14:25,940 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 05:14:25,940 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 05:14:25,941 INFO [Listener at localhost.localdomain/45981] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 05:14:25,952 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:25,952 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ab90c6aa8d038fa91b29a25a1b6725f7, disabling compactions & flushes 2023-07-12 05:14:25,952 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:14:25,952 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:14:25,952 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. after waiting 0 ms 2023-07-12 05:14:25,952 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:14:25,952 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:14:25,952 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ab90c6aa8d038fa91b29a25a1b6725f7: 2023-07-12 05:14:25,957 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 05:14:25,959 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689138865959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138865959"}]},"ts":"1689138865959"} 2023-07-12 05:14:25,962 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 05:14:25,964 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 05:14:25,965 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138865964"}]},"ts":"1689138865964"} 2023-07-12 05:14:25,967 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 05:14:25,970 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 05:14:25,972 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 05:14:25,972 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 05:14:25,972 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 05:14:25,972 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 05:14:25,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ab90c6aa8d038fa91b29a25a1b6725f7, ASSIGN}] 2023-07-12 05:14:25,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 05:14:25,976 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ab90c6aa8d038fa91b29a25a1b6725f7, ASSIGN 2023-07-12 05:14:25,977 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ab90c6aa8d038fa91b29a25a1b6725f7, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38155,1689138862340; forceNewPlan=false, retain=false 2023-07-12 05:14:26,128 INFO [jenkins-hbase20:36929] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 05:14:26,129 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ab90c6aa8d038fa91b29a25a1b6725f7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:26,129 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689138866129"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138866129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138866129"}]},"ts":"1689138866129"} 2023-07-12 05:14:26,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ab90c6aa8d038fa91b29a25a1b6725f7, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:14:26,173 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 05:14:26,292 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:14:26,292 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ab90c6aa8d038fa91b29a25a1b6725f7, NAME => 'hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7.', STARTKEY => '', ENDKEY => ''} 2023-07-12 05:14:26,293 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. service=AccessControlService 2023-07-12 05:14:26,293 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:14:26,293 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ab90c6aa8d038fa91b29a25a1b6725f7 2023-07-12 05:14:26,293 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:26,294 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ab90c6aa8d038fa91b29a25a1b6725f7 2023-07-12 05:14:26,294 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ab90c6aa8d038fa91b29a25a1b6725f7 2023-07-12 05:14:26,296 INFO [StoreOpener-ab90c6aa8d038fa91b29a25a1b6725f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ab90c6aa8d038fa91b29a25a1b6725f7 2023-07-12 05:14:26,300 DEBUG [StoreOpener-ab90c6aa8d038fa91b29a25a1b6725f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7/l 2023-07-12 05:14:26,300 DEBUG [StoreOpener-ab90c6aa8d038fa91b29a25a1b6725f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7/l 2023-07-12 05:14:26,301 INFO [StoreOpener-ab90c6aa8d038fa91b29a25a1b6725f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ab90c6aa8d038fa91b29a25a1b6725f7 columnFamilyName l 2023-07-12 05:14:26,302 INFO [StoreOpener-ab90c6aa8d038fa91b29a25a1b6725f7-1] regionserver.HStore(310): Store=ab90c6aa8d038fa91b29a25a1b6725f7/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:26,304 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7 2023-07-12 05:14:26,306 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7 2023-07-12 05:14:26,312 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ab90c6aa8d038fa91b29a25a1b6725f7 2023-07-12 05:14:26,317 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:14:26,318 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ab90c6aa8d038fa91b29a25a1b6725f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61070108, jitterRate=-0.0899844765663147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:14:26,319 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ab90c6aa8d038fa91b29a25a1b6725f7: 2023-07-12 05:14:26,320 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7., pid=11, masterSystemTime=1689138866287 2023-07-12 05:14:26,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:14:26,323 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:14:26,324 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ab90c6aa8d038fa91b29a25a1b6725f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:26,325 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689138866324"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138866324"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138866324"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138866324"}]},"ts":"1689138866324"} 2023-07-12 05:14:26,334 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 05:14:26,334 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ab90c6aa8d038fa91b29a25a1b6725f7, server=jenkins-hbase20.apache.org,38155,1689138862340 in 196 msec 2023-07-12 05:14:26,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 05:14:26,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ab90c6aa8d038fa91b29a25a1b6725f7, ASSIGN in 362 msec 2023-07-12 05:14:26,341 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 05:14:26,342 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138866341"}]},"ts":"1689138866341"} 2023-07-12 05:14:26,345 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 05:14:26,348 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 05:14:26,353 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 502 msec 2023-07-12 05:14:26,473 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 05:14:26,473 INFO [master/jenkins-hbase20:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 05:14:26,484 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 05:14:27,206 WARN [Thread-381] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 05:14:27,557 INFO [Thread-381] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 05:14:27,565 INFO [Thread-381] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_46075_jobhistory____.gpemev/webapp 2023-07-12 05:14:27,715 INFO [Thread-381] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 05:14:27,715 INFO [Thread-381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 05:14:27,715 INFO [Thread-381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 05:14:27,717 INFO [Thread-381] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 05:14:27,788 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 05:14:28,110 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 05:14:28,452 INFO [Thread-381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 05:14:28,486 INFO [Thread-381] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:46075 2023-07-12 05:14:28,689 WARN [Listener at jenkins-hbase20.apache.org/34357] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 05:14:28,996 WARN [Listener at jenkins-hbase20.apache.org/34357] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 05:14:28,997 INFO [Listener at jenkins-hbase20.apache.org/34357] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 05:14:29,049 INFO [Listener at jenkins-hbase20.apache.org/34357] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_38831_cluster____sfll27/webapp 2023-07-12 05:14:29,145 INFO [Listener at jenkins-hbase20.apache.org/34357] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 05:14:29,145 INFO [Listener at jenkins-hbase20.apache.org/34357] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 05:14:29,145 INFO [Listener at jenkins-hbase20.apache.org/34357] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 05:14:29,146 INFO [Listener at jenkins-hbase20.apache.org/34357] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 05:14:29,174 INFO [Listener at jenkins-hbase20.apache.org/34357] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 05:14:29,494 INFO [Listener at jenkins-hbase20.apache.org/34357] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 05:14:29,631 INFO [Listener at jenkins-hbase20.apache.org/34357] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 05:14:29,642 INFO [Listener at jenkins-hbase20.apache.org/34357] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:38831 2023-07-12 05:14:30,199 WARN [Listener at jenkins-hbase20.apache.org/39901] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 05:14:30,219 WARN [Listener at jenkins-hbase20.apache.org/39901] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 05:14:30,220 INFO [Listener at jenkins-hbase20.apache.org/39901] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 05:14:30,226 INFO [Listener at jenkins-hbase20.apache.org/39901] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_34191_node____.8udxk6/webapp 2023-07-12 05:14:30,269 INFO [Listener at jenkins-hbase20.apache.org/39901] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 05:14:30,269 INFO [Listener at jenkins-hbase20.apache.org/39901] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 05:14:30,269 INFO [Listener at jenkins-hbase20.apache.org/39901] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 05:14:30,270 INFO [Listener at jenkins-hbase20.apache.org/39901] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 05:14:30,280 INFO [Listener at jenkins-hbase20.apache.org/39901] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 05:14:30,301 INFO [Listener at jenkins-hbase20.apache.org/39901] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 05:14:30,320 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 05:14:30,436 INFO [Listener at jenkins-hbase20.apache.org/39901] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 05:14:30,462 INFO [Listener at jenkins-hbase20.apache.org/39901] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:34191 2023-07-12 05:14:30,492 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 05:14:30,493 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 05:14:30,494 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 05:14:30,755 WARN [Listener at jenkins-hbase20.apache.org/34425] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 05:14:30,764 WARN [Listener at jenkins-hbase20.apache.org/34425] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 05:14:30,765 INFO [Listener at jenkins-hbase20.apache.org/34425] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 05:14:30,773 INFO [Listener at jenkins-hbase20.apache.org/34425] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_44797_node____.g7buvt/webapp 2023-07-12 05:14:30,820 INFO [Listener at jenkins-hbase20.apache.org/34425] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 05:14:30,820 INFO [Listener at jenkins-hbase20.apache.org/34425] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 05:14:30,820 INFO [Listener at jenkins-hbase20.apache.org/34425] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 05:14:30,821 INFO [Listener at jenkins-hbase20.apache.org/34425] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 05:14:30,829 INFO [Listener at jenkins-hbase20.apache.org/34425] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 05:14:30,841 INFO [Listener at jenkins-hbase20.apache.org/34425] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 05:14:30,904 INFO [Listener at jenkins-hbase20.apache.org/34425] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 05:14:30,911 INFO [Listener at jenkins-hbase20.apache.org/34425] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:44797 2023-07-12 05:14:30,936 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 05:14:30,938 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:14:31,002 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=702, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=210, ProcessCount=169, AvailableMemoryMB=4159 2023-07-12 05:14:31,002 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=702 is superior to 500 2023-07-12 05:14:31,015 DEBUG [Listener at jenkins-hbase20.apache.org/34425] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 05:14:31,020 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 05:14:31,028 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 05:14:31,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 05:14:31,035 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 05:14:31,036 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 05:14:31,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 05:14:31,038 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 05:14:31,044 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:31,044 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:31,045 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5 empty. 2023-07-12 05:14:31,046 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21 empty. 2023-07-12 05:14:31,048 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:31,048 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:31,048 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 05:14:31,082 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 05:14:31,083 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 04eb328254b9be6327437eb720c15a21, NAME => 'testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:14:31,084 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 60bc40b59020dd1a6e05623e4b5cb8d5, NAME => 'testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:14:31,096 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:14:31,099 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 05:14:31,100 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:14:31,100 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 05:14:31,103 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 05:14:31,103 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 05:14:31,103 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:14:31,103 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 05:14:31,110 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 05:14:31,110 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 05:14:31,125 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:31,126 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 04eb328254b9be6327437eb720c15a21, disabling compactions & flushes 2023-07-12 05:14:31,126 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:31,126 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:31,126 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. after waiting 0 ms 2023-07-12 05:14:31,127 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:31,127 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:31,127 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 04eb328254b9be6327437eb720c15a21: 2023-07-12 05:14:31,128 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:31,128 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 60bc40b59020dd1a6e05623e4b5cb8d5, disabling compactions & flushes 2023-07-12 05:14:31,128 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:31,128 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:31,128 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. after waiting 0 ms 2023-07-12 05:14:31,128 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:31,128 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:31,128 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 60bc40b59020dd1a6e05623e4b5cb8d5: 2023-07-12 05:14:31,135 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 05:14:31,136 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689138871136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138871136"}]},"ts":"1689138871136"} 2023-07-12 05:14:31,136 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689138871136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138871136"}]},"ts":"1689138871136"} 2023-07-12 05:14:31,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 05:14:31,178 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 05:14:31,179 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 05:14:31,180 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138871179"}]},"ts":"1689138871179"} 2023-07-12 05:14:31,182 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 05:14:31,186 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 05:14:31,188 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 05:14:31,188 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 05:14:31,188 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 05:14:31,188 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 05:14:31,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=04eb328254b9be6327437eb720c15a21, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60bc40b59020dd1a6e05623e4b5cb8d5, ASSIGN}] 2023-07-12 05:14:31,192 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60bc40b59020dd1a6e05623e4b5cb8d5, ASSIGN 2023-07-12 05:14:31,192 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=04eb328254b9be6327437eb720c15a21, ASSIGN 2023-07-12 05:14:31,194 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60bc40b59020dd1a6e05623e4b5cb8d5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40199,1689138862404; forceNewPlan=false, retain=false 2023-07-12 05:14:31,194 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=04eb328254b9be6327437eb720c15a21, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38155,1689138862340; forceNewPlan=false, retain=false 2023-07-12 05:14:31,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 05:14:31,345 INFO [jenkins-hbase20:36929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 05:14:31,349 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=60bc40b59020dd1a6e05623e4b5cb8d5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:31,349 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=04eb328254b9be6327437eb720c15a21, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:31,349 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689138871349"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138871349"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138871349"}]},"ts":"1689138871349"} 2023-07-12 05:14:31,349 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689138871349"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138871349"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138871349"}]},"ts":"1689138871349"} 2023-07-12 05:14:31,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 60bc40b59020dd1a6e05623e4b5cb8d5, server=jenkins-hbase20.apache.org,40199,1689138862404}] 2023-07-12 05:14:31,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 04eb328254b9be6327437eb720c15a21, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:14:31,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:31,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:31,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 60bc40b59020dd1a6e05623e4b5cb8d5, NAME => 'testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 05:14:31,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 04eb328254b9be6327437eb720c15a21, NAME => 'testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 05:14:31,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. service=AccessControlService 2023-07-12 05:14:31,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. service=AccessControlService 2023-07-12 05:14:31,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:14:31,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:14:31,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:31,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:31,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:31,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:31,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:31,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:31,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:31,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:31,519 INFO [StoreOpener-04eb328254b9be6327437eb720c15a21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:31,519 INFO [StoreOpener-60bc40b59020dd1a6e05623e4b5cb8d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:31,521 DEBUG [StoreOpener-60bc40b59020dd1a6e05623e4b5cb8d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/cf 2023-07-12 05:14:31,521 DEBUG [StoreOpener-60bc40b59020dd1a6e05623e4b5cb8d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/cf 2023-07-12 05:14:31,521 DEBUG [StoreOpener-04eb328254b9be6327437eb720c15a21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/cf 2023-07-12 05:14:31,521 DEBUG [StoreOpener-04eb328254b9be6327437eb720c15a21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/cf 2023-07-12 05:14:31,524 INFO [StoreOpener-60bc40b59020dd1a6e05623e4b5cb8d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 60bc40b59020dd1a6e05623e4b5cb8d5 columnFamilyName cf 2023-07-12 05:14:31,524 INFO [StoreOpener-04eb328254b9be6327437eb720c15a21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04eb328254b9be6327437eb720c15a21 columnFamilyName cf 2023-07-12 05:14:31,526 INFO [StoreOpener-60bc40b59020dd1a6e05623e4b5cb8d5-1] regionserver.HStore(310): Store=60bc40b59020dd1a6e05623e4b5cb8d5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:31,526 INFO [StoreOpener-04eb328254b9be6327437eb720c15a21-1] regionserver.HStore(310): Store=04eb328254b9be6327437eb720c15a21/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:31,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:31,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:31,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:31,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:31,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:31,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:31,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:14:31,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 04eb328254b9be6327437eb720c15a21; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71503371, jitterRate=0.06548325717449188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:14:31,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 04eb328254b9be6327437eb720c15a21: 2023-07-12 05:14:31,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:14:31,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21., pid=16, masterSystemTime=1689138871507 2023-07-12 05:14:31,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 60bc40b59020dd1a6e05623e4b5cb8d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64283261, jitterRate=-0.04210476577281952}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:14:31,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 60bc40b59020dd1a6e05623e4b5cb8d5: 2023-07-12 05:14:31,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5., pid=15, masterSystemTime=1689138871506 2023-07-12 05:14:31,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:31,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:31,583 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=04eb328254b9be6327437eb720c15a21, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:31,583 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689138871583"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138871583"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138871583"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138871583"}]},"ts":"1689138871583"} 2023-07-12 05:14:31,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:31,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:31,586 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=60bc40b59020dd1a6e05623e4b5cb8d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:31,588 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689138871586"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138871586"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138871586"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138871586"}]},"ts":"1689138871586"} 2023-07-12 05:14:31,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-12 05:14:31,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 04eb328254b9be6327437eb720c15a21, server=jenkins-hbase20.apache.org,38155,1689138862340 in 234 msec 2023-07-12 05:14:31,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-12 05:14:31,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 60bc40b59020dd1a6e05623e4b5cb8d5, server=jenkins-hbase20.apache.org,40199,1689138862404 in 239 msec 2023-07-12 05:14:31,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=04eb328254b9be6327437eb720c15a21, ASSIGN in 405 msec 2023-07-12 05:14:31,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-12 05:14:31,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60bc40b59020dd1a6e05623e4b5cb8d5, ASSIGN in 408 msec 2023-07-12 05:14:31,605 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 05:14:31,605 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138871605"}]},"ts":"1689138871605"} 2023-07-12 05:14:31,612 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 05:14:31,617 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 05:14:31,624 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 05:14:31,639 DEBUG [hconnection-0x27fd8e27-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:31,640 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-12 05:14:31,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 05:14:31,667 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 05:14:31,704 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:31,704 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:31,705 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:31,705 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:31,705 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 05:14:31,735 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 05:14:31,735 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 05:14:31,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 05:14:31,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 05:14:31,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 05:14:31,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 05:14:31,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 708 msec 2023-07-12 05:14:32,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 05:14:32,155 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 05:14:32,162 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 05:14:32,164 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:32,167 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:14:32,228 DEBUG [hconnection-0x29eb03d4-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:32,246 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:32,288 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 05:14:32,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138872288 (current time:1689138872288). 2023-07-12 05:14:32,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:14:32,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x0009dbc5 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:32,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4592e4a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:32,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:32,321 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:32,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0009dbc5 to 127.0.0.1:53723 2023-07-12 05:14:32,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:14:32,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x1c79bd17 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:32,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4739a29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:32,438 DEBUG [hconnection-0x64527b58-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:32,443 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:32,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:32,453 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:32,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c79bd17 to 127.0.0.1:53723 2023-07-12 05:14:32,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:14:32,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 05:14:32,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:14:32,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 05:14:32,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 05:14:32,507 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 05:14:32,510 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689139472510 2023-07-12 05:14:32,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 05:14:32,514 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 05:14:32,517 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 05:14:32,522 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:14:32,522 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:14:32,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 05:14:32,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 21 msec 2023-07-12 05:14:32,528 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 05:14:32,530 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689139472530 2023-07-12 05:14:32,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,585 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 05:14:32,585 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:32,587 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 05:14:32,587 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 05:14:32,588 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,588 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,590 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:32,590 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:32,590 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:32,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:32,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:32,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:32,591 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:32,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:32,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:32,591 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,591 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,592 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,593 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:14:32,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 05:14:32,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 05:14:32,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,593 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 05:14:32,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 05:14:32,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,595 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 05:14:32,595 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 05:14:32,598 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,598 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,599 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,599 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 05:14:32,599 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 05:14:32,599 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:32,599 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 05:14:32,601 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 05:14:32,599 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:32,601 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 05:14:32,601 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:32,603 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 05:14:32,603 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 05:14:32,604 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 05:14:32,604 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 05:14:32,604 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 05:14:32,604 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 05:14:32,604 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 05:14:32,607 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,607 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,607 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,607 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:32,608 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,608 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:32,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:32,609 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,610 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,610 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,610 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,610 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:32,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 05:14:32,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ba0ba[Count = 1] remaining members to acquire global barrier 2023-07-12 05:14:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:32,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:32,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 05:14:32,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ba0ba[Count = 0] remaining members to acquire global barrier 2023-07-12 05:14:32,614 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 05:14:32,614 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,616 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,617 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,616 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,617 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 05:14:32,617 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,617 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 05:14:32,617 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,617 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:14:32,618 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 05:14:32,618 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 05:14:32,618 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:14:32,618 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:14:32,618 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:32,618 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:14:32,618 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:14:32,618 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:32,618 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:14:32,619 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. started... 2023-07-12 05:14:32,619 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. started... 2023-07-12 05:14:32,622 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 05:14:32,622 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:14:32,622 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:32,623 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 05:14:32,625 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04eb328254b9be6327437eb720c15a21: 2023-07-12 05:14:32,625 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 60bc40b59020dd1a6e05623e4b5cb8d5: 2023-07-12 05:14:32,626 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,626 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 05:14:32,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:14:32,628 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:14:32,632 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:14:32,632 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:14:32,637 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:14:32,637 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:14:32,703 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. completed. 2023-07-12 05:14:32,703 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:32,707 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:14:32,707 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:14:32,707 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,708 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 05:14:32,708 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:14:32,710 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,710 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 05:14:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:32,710 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:32,710 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. completed. 2023-07-12 05:14:32,712 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:14:32,710 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 05:14:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:14:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 05:14:32,712 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:14:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:32,714 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 05:14:32,714 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:32,714 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:32,714 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 05:14:32,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:32,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,40199,1689138862404': 2023-07-12 05:14:32,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 05:14:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,38155,1689138862340': 2023-07-12 05:14:32,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 05:14:32,725 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 05:14:32,725 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:14:32,725 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:14:32,726 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,726 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:14:32,728 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,728 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,728 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:32,728 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,728 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,729 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,728 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:32,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:32,729 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:32,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,730 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,731 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,733 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,733 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:32,734 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,756 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,756 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,756 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:32,756 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:32,756 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,756 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:32,756 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:32,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:32,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:32,756 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:32,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:32,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:32,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:32,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:32,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:32,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:32,757 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:32,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:32,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:32,756 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:32,756 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:32,757 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 05:14:32,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:32,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:32,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:14:32,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:32,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:32,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 05:14:32,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,829 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:14:32,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 05:14:32,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:14:32,831 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 05:14:32,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,909 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 05:14:32,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,910 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:32,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689138872514Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689138872782 (+268 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689138872782Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689138872782Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689138872799 (+17 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689138872842 (+43 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689138872909 (+67 ms) 2023-07-12 05:14:32,913 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 05:14:32,915 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 394 msec 2023-07-12 05:14:33,131 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:14:33,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 05:14:33,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:14:33,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38155] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:14:33,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40199] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:14:33,153 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 05:14:33,154 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:33,154 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:14:33,172 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 05:14:33,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138873172 (current time:1689138873172). 2023-07-12 05:14:33,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:14:33,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x127ed80a to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:33,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35789e12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:33,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:33,184 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:33,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x127ed80a to 127.0.0.1:53723 2023-07-12 05:14:33,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:14:33,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x113fa871 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:33,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75658cd4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:33,197 DEBUG [hconnection-0x49c0464-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:33,198 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:33,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:33,207 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:33,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x113fa871 to 127.0.0.1:53723 2023-07-12 05:14:33,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:14:33,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 05:14:33,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:14:33,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 05:14:33,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 05:14:33,215 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 05:14:33,216 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689139473216 2023-07-12 05:14:33,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 05:14:33,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 05:14:33,217 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:14:33,218 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:14:33,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 05:14:33,219 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 05:14:33,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-12 05:14:33,223 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 05:14:33,224 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689139473224 2023-07-12 05:14:33,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 05:14:33,243 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 05:14:33,243 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:33,244 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 05:14:33,244 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 05:14:33,245 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,245 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,246 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:33,246 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:33,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:33,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:33,246 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:33,246 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,247 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,247 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,247 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,247 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:14:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 05:14:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,247 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 05:14:33,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 05:14:33,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,248 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 05:14:33,248 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 05:14:33,248 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:33,248 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 05:14:33,249 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 05:14:33,249 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 05:14:33,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 05:14:33,249 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 05:14:33,249 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 05:14:33,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,249 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 05:14:33,249 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:33,249 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 05:14:33,251 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 05:14:33,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 05:14:33,251 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 05:14:33,251 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 05:14:33,251 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:33,251 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 05:14:33,254 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 05:14:33,254 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 05:14:33,254 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 05:14:33,260 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,260 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:33,267 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,267 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,267 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,267 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,267 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:33,267 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,268 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:33,267 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,268 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 05:14:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:33,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 05:14:33,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11767069[Count = 1] remaining members to acquire global barrier 2023-07-12 05:14:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:33,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 05:14:33,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:33,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:33,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 05:14:33,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11767069[Count = 0] remaining members to acquire global barrier 2023-07-12 05:14:33,275 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 05:14:33,275 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,278 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,278 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,278 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,278 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 05:14:33,279 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 05:14:33,279 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 05:14:33,279 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,279 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:14:33,279 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:33,279 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:14:33,279 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. started... 2023-07-12 05:14:33,279 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:14:33,279 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 05:14:33,279 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,280 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:14:33,280 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 04eb328254b9be6327437eb720c15a21 1/1 column families, dataSize=534 B heapSize=1.38 KB 2023-07-12 05:14:33,280 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:14:33,280 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:33,282 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 05:14:33,280 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:14:33,287 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:33,287 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 05:14:33,286 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. started... 2023-07-12 05:14:33,292 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 60bc40b59020dd1a6e05623e4b5cb8d5 1/1 column families, dataSize=2.74 KB heapSize=6.16 KB 2023-07-12 05:14:33,318 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:14:33,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 05:14:33,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:14:33,322 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:14:33,446 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712deba1bfcca3c4bbe8486161642f118bd to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230712deba1bfcca3c4bbe8486161642f118bd 2023-07-12 05:14:33,446 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307129d79535def6c40b2834c1e3f8101ea7c to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307129d79535def6c40b2834c1e3f8101ea7c 2023-07-12 05:14:33,496 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=534, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/.tmp/cf/f526c81c3e044f85a29807670ae0e038 2023-07-12 05:14:33,522 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:14:33,524 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/.tmp/cf/f526c81c3e044f85a29807670ae0e038 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/cf/f526c81c3e044f85a29807670ae0e038 2023-07-12 05:14:33,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 05:14:33,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:14:33,525 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 05:14:33,536 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/cf/f526c81c3e044f85a29807670ae0e038, entries=8, sequenceid=6, filesize=6.2 K 2023-07-12 05:14:33,539 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~534 B/534, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 04eb328254b9be6327437eb720c15a21 in 259ms, sequenceid=6, compaction requested=false 2023-07-12 05:14:33,539 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 05:14:33,539 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04eb328254b9be6327437eb720c15a21: 2023-07-12 05:14:33,540 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 05:14:33,540 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:14:33,540 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/cf/f526c81c3e044f85a29807670ae0e038] hfiles 2023-07-12 05:14:33,540 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/cf/f526c81c3e044f85a29807670ae0e038 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 05:14:33,571 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. completed. 2023-07-12 05:14:33,571 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:33,571 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:14:33,571 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:14:33,571 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,571 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 05:14:33,571 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:14:33,572 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,572 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 05:14:33,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:33,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:33,572 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:33,572 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 05:14:33,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:33,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:33,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 05:14:33,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:33,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:33,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 05:14:33,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:33,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,38155,1689138862340': 2023-07-12 05:14:33,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 05:14:33,827 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:14:33,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 05:14:33,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:14:33,829 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 05:14:33,889 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.7 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/.tmp/cf/cdd5b616940d4dc6917a890930ce75d1 2023-07-12 05:14:33,900 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/.tmp/cf/cdd5b616940d4dc6917a890930ce75d1 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/cf/cdd5b616940d4dc6917a890930ce75d1 2023-07-12 05:14:33,912 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/cf/cdd5b616940d4dc6917a890930ce75d1, entries=42, sequenceid=6, filesize=12.0 K 2023-07-12 05:14:33,914 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.74 KB/2802, heapSize ~6.14 KB/6288, currentSize=0 B/0 for 60bc40b59020dd1a6e05623e4b5cb8d5 in 622ms, sequenceid=6, compaction requested=false 2023-07-12 05:14:33,916 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 60bc40b59020dd1a6e05623e4b5cb8d5: 2023-07-12 05:14:33,916 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 05:14:33,916 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:14:33,916 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/cf/cdd5b616940d4dc6917a890930ce75d1] hfiles 2023-07-12 05:14:33,916 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/cf/cdd5b616940d4dc6917a890930ce75d1 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 05:14:33,941 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. completed. 2023-07-12 05:14:33,942 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:33,942 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:14:33,943 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:14:33,943 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,943 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 05:14:33,943 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:14:33,946 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:33,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:33,946 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 05:14:33,946 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:33,946 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 05:14:33,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:33,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:33,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 05:14:33,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:33,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:33,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 05:14:33,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:33,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,40199,1689138862404': 2023-07-12 05:14:33,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 05:14:33,952 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 05:14:33,952 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:14:33,952 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:14:33,952 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 05:14:33,952 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:14:33,958 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,958 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,958 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:33,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,959 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,959 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:33,959 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,958 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:33,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:33,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:33,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:33,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:33,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:33,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:33,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,975 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:33,976 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 05:14:33,977 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 05:14:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:33,980 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:33,980 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:33,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 05:14:33,981 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:33,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:33,999 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:33,999 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:33,999 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:33,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:33,999 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:33,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 05:14:33,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:33,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:33,999 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:33,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:33,999 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 05:14:33,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:33,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:33,999 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:33,999 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:33,999 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:34,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:34,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:34,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:34,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:34,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:34,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:33,999 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:34,002 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:33,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 05:14:34,002 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 05:14:34,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 05:14:34,002 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:34,002 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:34,002 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:34,002 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:34,002 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 05:14:34,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:14:34,002 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 05:14:34,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307129d79535def6c40b2834c1e3f8101ea7c, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230712deba1bfcca3c4bbe8486161642f118bd] mob files 2023-07-12 05:14:34,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307129d79535def6c40b2834c1e3f8101ea7c 2023-07-12 05:14:34,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230712deba1bfcca3c4bbe8486161642f118bd 2023-07-12 05:14:34,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 05:14:34,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 05:14:34,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 05:14:34,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 05:14:34,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 05:14:34,163 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 05:14:34,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689138873216Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689138874040 (+824 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689138874040Loading Region manifests for snaptb0-testExportWithTargetName at 1689138874041 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689138874081 (+40 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689138874107 (+26 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689138874162 (+55 ms) 2023-07-12 05:14:34,166 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 05:14:34,169 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 950 msec 2023-07-12 05:14:34,329 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:14:34,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 05:14:34,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:14:34,333 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138874333 2023-07-12 05:14:34,333 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:43005, tgtDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138874333, rawTgtDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138874333, srcFsUri=hdfs://localhost.localdomain:43005, srcDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:14:34,369 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:14:34,370 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_281784649_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138874333, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138874333/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 05:14:34,370 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b, snapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 05:14:34,392 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138874333/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 05:14:34,477 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,478 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,479 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,479 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,480 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,480 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,481 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,563 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/hadoop-2427304894742504175.jar 2023-07-12 05:14:34,564 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,564 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,565 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,565 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,566 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,566 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:34,567 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 05:14:34,567 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 05:14:34,568 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 05:14:34,568 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 05:14:34,568 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 05:14:34,569 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 05:14:34,569 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 05:14:34,570 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 05:14:34,570 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 05:14:34,571 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 05:14:34,574 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:14:34,574 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:14:34,574 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:14:34,575 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:14:34,575 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:14:34,575 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:14:34,576 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:14:35,454 WARN [Listener at jenkins-hbase20.apache.org/34425] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 05:14:35,461 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 05:14:35,473 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 05:14:35,882 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:14:35,883 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:14:36,088 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0001_000001 (auth:SIMPLE) 2023-07-12 05:14:37,028 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 05:14:40,584 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0001_000001 (auth:SIMPLE) 2023-07-12 05:14:42,867 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0001_000001 (auth:SIMPLE) 2023-07-12 05:14:46,569 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0001_000001 (auth:SIMPLE) 2023-07-12 05:14:48,288 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 05:14:48,291 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 05:14:48,301 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 05:14:48,301 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 05:14:48,302 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 05:14:48,302 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 05:14:48,303 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 05:14:48,303 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 05:14:48,303 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138874333/.hbase-snapshot/testExportWithTargetName at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138874333/.hbase-snapshot/testExportWithTargetName 2023-07-12 05:14:48,304 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138874333/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 05:14:48,304 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138874333/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 05:14:48,315 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 05:14:48,320 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportWithTargetName 2023-07-12 05:14:48,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 05:14:48,335 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138888335"}]},"ts":"1689138888335"} 2023-07-12 05:14:48,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 05:14:48,337 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 05:14:48,339 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 05:14:48,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=04eb328254b9be6327437eb720c15a21, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60bc40b59020dd1a6e05623e4b5cb8d5, UNASSIGN}] 2023-07-12 05:14:48,343 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=04eb328254b9be6327437eb720c15a21, UNASSIGN 2023-07-12 05:14:48,343 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60bc40b59020dd1a6e05623e4b5cb8d5, UNASSIGN 2023-07-12 05:14:48,345 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=04eb328254b9be6327437eb720c15a21, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:48,345 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=60bc40b59020dd1a6e05623e4b5cb8d5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:48,345 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689138888344"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138888344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138888344"}]},"ts":"1689138888344"} 2023-07-12 05:14:48,345 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689138888344"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138888344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138888344"}]},"ts":"1689138888344"} 2023-07-12 05:14:48,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 04eb328254b9be6327437eb720c15a21, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:14:48,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 60bc40b59020dd1a6e05623e4b5cb8d5, server=jenkins-hbase20.apache.org,40199,1689138862404}] 2023-07-12 05:14:48,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 05:14:48,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:48,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:48,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 60bc40b59020dd1a6e05623e4b5cb8d5, disabling compactions & flushes 2023-07-12 05:14:48,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 04eb328254b9be6327437eb720c15a21, disabling compactions & flushes 2023-07-12 05:14:48,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:48,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:48,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:48,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. after waiting 0 ms 2023-07-12 05:14:48,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:48,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:48,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. after waiting 0 ms 2023-07-12 05:14:48,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:48,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:14:48,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:14:48,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:14:48,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:14:48,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21. 2023-07-12 05:14:48,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 04eb328254b9be6327437eb720c15a21: 2023-07-12 05:14:48,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5. 2023-07-12 05:14:48,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 60bc40b59020dd1a6e05623e4b5cb8d5: 2023-07-12 05:14:48,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:48,534 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=04eb328254b9be6327437eb720c15a21, regionState=CLOSED 2023-07-12 05:14:48,535 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689138888534"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138888534"}]},"ts":"1689138888534"} 2023-07-12 05:14:48,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:48,536 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=60bc40b59020dd1a6e05623e4b5cb8d5, regionState=CLOSED 2023-07-12 05:14:48,537 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689138888536"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138888536"}]},"ts":"1689138888536"} 2023-07-12 05:14:48,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-12 05:14:48,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 04eb328254b9be6327437eb720c15a21, server=jenkins-hbase20.apache.org,38155,1689138862340 in 189 msec 2023-07-12 05:14:48,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-12 05:14:48,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=04eb328254b9be6327437eb720c15a21, UNASSIGN in 198 msec 2023-07-12 05:14:48,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 60bc40b59020dd1a6e05623e4b5cb8d5, server=jenkins-hbase20.apache.org,40199,1689138862404 in 190 msec 2023-07-12 05:14:48,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-12 05:14:48,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=60bc40b59020dd1a6e05623e4b5cb8d5, UNASSIGN in 199 msec 2023-07-12 05:14:48,544 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138888544"}]},"ts":"1689138888544"} 2023-07-12 05:14:48,545 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 05:14:48,547 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 05:14:48,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 224 msec 2023-07-12 05:14:48,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 05:14:48,641 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 05:14:48,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportWithTargetName 2023-07-12 05:14:48,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 05:14:48,659 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 05:14:48,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 05:14:48,661 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 05:14:48,664 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 05:14:48,665 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 05:14:48,665 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 05:14:48,665 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 05:14:48,665 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 05:14:48,666 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 05:14:48,666 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 05:14:48,666 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 05:14:48,666 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 05:14:48,666 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:48,666 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 05:14:48,666 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 05:14:48,667 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 05:14:48,666 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 05:14:48,667 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:48,667 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:48,667 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:48,666 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:48,668 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:48,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 05:14:48,672 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/recovered.edits] 2023-07-12 05:14:48,672 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/recovered.edits] 2023-07-12 05:14:48,679 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/cf/f526c81c3e044f85a29807670ae0e038 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/cf/f526c81c3e044f85a29807670ae0e038 2023-07-12 05:14:48,679 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/cf/cdd5b616940d4dc6917a890930ce75d1 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/cf/cdd5b616940d4dc6917a890930ce75d1 2023-07-12 05:14:48,682 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21/recovered.edits/9.seqid 2023-07-12 05:14:48,684 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5/recovered.edits/9.seqid 2023-07-12 05:14:48,685 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/04eb328254b9be6327437eb720c15a21 2023-07-12 05:14:48,686 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportWithTargetName/60bc40b59020dd1a6e05623e4b5cb8d5 2023-07-12 05:14:48,686 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 05:14:48,686 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 05:14:48,687 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-12 05:14:48,691 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307129d79535def6c40b2834c1e3f8101ea7c to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307129d79535def6c40b2834c1e3f8101ea7c 2023-07-12 05:14:48,693 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230712deba1bfcca3c4bbe8486161642f118bd to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230712deba1bfcca3c4bbe8486161642f118bd 2023-07-12 05:14:48,693 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 05:14:48,696 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 05:14:48,722 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 05:14:48,725 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 05:14:48,727 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 05:14:48,727 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 05:14:48,727 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138888727"}]},"ts":"9223372036854775807"} 2023-07-12 05:14:48,727 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138888727"}]},"ts":"9223372036854775807"} 2023-07-12 05:14:48,730 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 05:14:48,731 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 04eb328254b9be6327437eb720c15a21, NAME => 'testtb-testExportWithTargetName,,1689138871028.04eb328254b9be6327437eb720c15a21.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 60bc40b59020dd1a6e05623e4b5cb8d5, NAME => 'testtb-testExportWithTargetName,1,1689138871028.60bc40b59020dd1a6e05623e4b5cb8d5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 05:14:48,731 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 05:14:48,731 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689138888731"}]},"ts":"9223372036854775807"} 2023-07-12 05:14:48,734 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 05:14:48,737 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 05:14:48,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 86 msec 2023-07-12 05:14:48,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 05:14:48,773 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 05:14:48,794 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 05:14:48,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 05:14:48,801 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 05:14:48,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 05:14:48,835 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 702) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36667302) connection to jenkins-hbase20.apache.org/148.251.75.209:39901 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1685654056_1 at /127.0.0.1:58652 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:39144 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1685654056_1 at /127.0.0.1:57206 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:58668 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36667302) connection to jenkins-hbase20.apache.org/148.251.75.209:46631 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-1310 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36667302) connection to jenkins-hbase20.apache.org/148.251.75.209:43329 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:57242 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 210) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=2628 (was 4159) 2023-07-12 05:14:48,835 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-12 05:14:48,855 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=239, ProcessCount=172, AvailableMemoryMB=2627 2023-07-12 05:14:48,855 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-12 05:14:48,857 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 05:14:48,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 05:14:48,863 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 05:14:48,864 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 05:14:48,865 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 05:14:48,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 05:14:48,868 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d 2023-07-12 05:14:48,868 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:14:48,869 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d empty. 2023-07-12 05:14:48,869 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd empty. 2023-07-12 05:14:48,869 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d 2023-07-12 05:14:48,869 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:14:48,869 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 05:14:48,883 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 05:14:48,884 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 442f86547c630e808e09d70df749736d, NAME => 'testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:14:48,884 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 920c49acba8ab40728a437dfba6d7edd, NAME => 'testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:14:48,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:48,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:48,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 442f86547c630e808e09d70df749736d, disabling compactions & flushes 2023-07-12 05:14:48,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 920c49acba8ab40728a437dfba6d7edd, disabling compactions & flushes 2023-07-12 05:14:48,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:48,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:14:48,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:48,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:14:48,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. after waiting 0 ms 2023-07-12 05:14:48,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. after waiting 0 ms 2023-07-12 05:14:48,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:48,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:14:48,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:48,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:14:48,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 442f86547c630e808e09d70df749736d: 2023-07-12 05:14:48,908 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 920c49acba8ab40728a437dfba6d7edd: 2023-07-12 05:14:48,912 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 05:14:48,914 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689138888913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138888913"}]},"ts":"1689138888913"} 2023-07-12 05:14:48,914 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689138888913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138888913"}]},"ts":"1689138888913"} 2023-07-12 05:14:48,918 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 05:14:48,919 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 05:14:48,920 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138888920"}]},"ts":"1689138888920"} 2023-07-12 05:14:48,922 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 05:14:48,924 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 05:14:48,926 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 05:14:48,926 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 05:14:48,926 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 05:14:48,926 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 05:14:48,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=442f86547c630e808e09d70df749736d, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=920c49acba8ab40728a437dfba6d7edd, ASSIGN}] 2023-07-12 05:14:48,931 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=920c49acba8ab40728a437dfba6d7edd, ASSIGN 2023-07-12 05:14:48,931 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=442f86547c630e808e09d70df749736d, ASSIGN 2023-07-12 05:14:48,932 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=442f86547c630e808e09d70df749736d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37993,1689138862265; forceNewPlan=false, retain=false 2023-07-12 05:14:48,932 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=920c49acba8ab40728a437dfba6d7edd, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38155,1689138862340; forceNewPlan=false, retain=false 2023-07-12 05:14:48,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 05:14:49,083 INFO [jenkins-hbase20:36929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 05:14:49,086 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=920c49acba8ab40728a437dfba6d7edd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,086 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=442f86547c630e808e09d70df749736d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,086 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689138889086"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138889086"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138889086"}]},"ts":"1689138889086"} 2023-07-12 05:14:49,086 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689138889086"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138889086"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138889086"}]},"ts":"1689138889086"} 2023-07-12 05:14:49,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 920c49acba8ab40728a437dfba6d7edd, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:14:49,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 442f86547c630e808e09d70df749736d, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:14:49,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 05:14:49,248 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,248 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 05:14:49,252 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 05:14:49,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:14:49,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 920c49acba8ab40728a437dfba6d7edd, NAME => 'testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 05:14:49,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. service=AccessControlService 2023-07-12 05:14:49,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:14:49,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:14:49,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:49,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:14:49,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:14:49,262 INFO [StoreOpener-920c49acba8ab40728a437dfba6d7edd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:14:49,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:49,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 442f86547c630e808e09d70df749736d, NAME => 'testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 05:14:49,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. service=AccessControlService 2023-07-12 05:14:49,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:14:49,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 442f86547c630e808e09d70df749736d 2023-07-12 05:14:49,264 DEBUG [StoreOpener-920c49acba8ab40728a437dfba6d7edd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/cf 2023-07-12 05:14:49,264 DEBUG [StoreOpener-920c49acba8ab40728a437dfba6d7edd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/cf 2023-07-12 05:14:49,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:14:49,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 442f86547c630e808e09d70df749736d 2023-07-12 05:14:49,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 442f86547c630e808e09d70df749736d 2023-07-12 05:14:49,264 INFO [StoreOpener-920c49acba8ab40728a437dfba6d7edd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 920c49acba8ab40728a437dfba6d7edd columnFamilyName cf 2023-07-12 05:14:49,265 INFO [StoreOpener-442f86547c630e808e09d70df749736d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 442f86547c630e808e09d70df749736d 2023-07-12 05:14:49,266 INFO [StoreOpener-920c49acba8ab40728a437dfba6d7edd-1] regionserver.HStore(310): Store=920c49acba8ab40728a437dfba6d7edd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:49,267 DEBUG [StoreOpener-442f86547c630e808e09d70df749736d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/cf 2023-07-12 05:14:49,267 DEBUG [StoreOpener-442f86547c630e808e09d70df749736d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/cf 2023-07-12 05:14:49,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:14:49,267 INFO [StoreOpener-442f86547c630e808e09d70df749736d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 442f86547c630e808e09d70df749736d columnFamilyName cf 2023-07-12 05:14:49,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:14:49,269 INFO [StoreOpener-442f86547c630e808e09d70df749736d-1] regionserver.HStore(310): Store=442f86547c630e808e09d70df749736d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:14:49,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d 2023-07-12 05:14:49,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d 2023-07-12 05:14:49,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:14:49,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:14:49,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 442f86547c630e808e09d70df749736d 2023-07-12 05:14:49,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 920c49acba8ab40728a437dfba6d7edd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68913308, jitterRate=0.02688831090927124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:14:49,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 920c49acba8ab40728a437dfba6d7edd: 2023-07-12 05:14:49,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd., pid=30, masterSystemTime=1689138889248 2023-07-12 05:14:49,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:14:49,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 442f86547c630e808e09d70df749736d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61453775, jitterRate=-0.08426739275455475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:14:49,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 442f86547c630e808e09d70df749736d: 2023-07-12 05:14:49,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:14:49,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:14:49,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d., pid=31, masterSystemTime=1689138889248 2023-07-12 05:14:49,282 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=920c49acba8ab40728a437dfba6d7edd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,285 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689138889282"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138889282"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138889282"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138889282"}]},"ts":"1689138889282"} 2023-07-12 05:14:49,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:49,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:49,288 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=442f86547c630e808e09d70df749736d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,289 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689138889288"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138889288"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138889288"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138889288"}]},"ts":"1689138889288"} 2023-07-12 05:14:49,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-12 05:14:49,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 920c49acba8ab40728a437dfba6d7edd, server=jenkins-hbase20.apache.org,38155,1689138862340 in 200 msec 2023-07-12 05:14:49,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=920c49acba8ab40728a437dfba6d7edd, ASSIGN in 365 msec 2023-07-12 05:14:49,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-12 05:14:49,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 442f86547c630e808e09d70df749736d, server=jenkins-hbase20.apache.org,37993,1689138862265 in 200 msec 2023-07-12 05:14:49,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-12 05:14:49,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=442f86547c630e808e09d70df749736d, ASSIGN in 367 msec 2023-07-12 05:14:49,296 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 05:14:49,296 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138889296"}]},"ts":"1689138889296"} 2023-07-12 05:14:49,298 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 05:14:49,300 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 05:14:49,300 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 05:14:49,303 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 05:14:49,309 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:49,310 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:49,310 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:49,310 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:14:49,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 05:14:49,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 05:14:49,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 05:14:49,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 05:14:49,314 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 453 msec 2023-07-12 05:14:49,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 05:14:49,469 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 05:14:49,472 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 05:14:49,472 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:49,475 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:14:49,489 DEBUG [hconnection-0x29eb03d4-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:49,494 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:49,500 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:14:49,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138889500 (current time:1689138889500). 2023-07-12 05:14:49,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:14:49,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x367373b2 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:49,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7072d2b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:49,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:49,515 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:49,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x367373b2 to 127.0.0.1:53723 2023-07-12 05:14:49,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:14:49,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x541ed408 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:49,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@795dd3da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:49,528 DEBUG [hconnection-0x1fdc412c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:49,529 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:49,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:49,535 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:49,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x541ed408 to 127.0.0.1:53723 2023-07-12 05:14:49,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:14:49,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 05:14:49,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:14:49,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:14:49,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:14:49,541 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:14:49,542 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689139489542 2023-07-12 05:14:49,542 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 05:14:49,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:14:49,544 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:14:49,544 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:14:49,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 05:14:49,545 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:14:49,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 05:14:49,548 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 05:14:49,549 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689139489549 2023-07-12 05:14:49,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,559 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 05:14:49,560 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:49,561 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 05:14:49,561 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 05:14:49,562 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,562 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,562 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:49,562 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:49,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:49,562 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:49,562 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:49,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:49,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:49,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:49,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:49,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,563 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,563 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,563 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,563 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:14:49,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 05:14:49,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 05:14:49,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 05:14:49,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,564 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 05:14:49,564 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 05:14:49,564 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 05:14:49,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,564 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 05:14:49,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,564 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:49,564 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 05:14:49,564 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:49,565 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,566 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 05:14:49,567 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 05:14:49,567 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:49,566 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 05:14:49,568 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 05:14:49,568 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 05:14:49,568 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 05:14:49,568 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 05:14:49,568 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 05:14:49,567 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 05:14:49,568 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 05:14:49,574 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,577 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,577 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,577 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,577 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,578 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:49,578 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:49,578 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,578 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:49,578 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,578 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:49,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:49,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:49,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 05:14:49,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2498f6d7[Count = 1] remaining members to acquire global barrier 2023-07-12 05:14:49,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:49,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:49,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:49,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:49,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:49,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 05:14:49,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2498f6d7[Count = 0] remaining members to acquire global barrier 2023-07-12 05:14:49,582 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 05:14:49,582 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,584 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,584 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,584 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,585 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,585 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:14:49,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,585 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:14:49,585 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,585 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:14:49,585 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:14:49,585 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:14:49,585 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:14:49,585 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:49,585 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. started... 2023-07-12 05:14:49,585 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. started... 2023-07-12 05:14:49,585 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:14:49,585 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:14:49,585 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:14:49,587 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 920c49acba8ab40728a437dfba6d7edd: 2023-07-12 05:14:49,587 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 442f86547c630e808e09d70df749736d: 2023-07-12 05:14:49,585 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 05:14:49,587 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:14:49,587 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,587 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,587 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:14:49,587 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:14:49,587 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:14:49,588 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:14:49,588 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 05:14:49,588 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:49,589 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 05:14:49,603 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. completed. 2023-07-12 05:14:49,603 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:49,603 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. completed. 2023-07-12 05:14:49,603 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:14:49,603 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:14:49,603 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:14:49,603 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,603 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:14:49,603 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:14:49,603 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 05:14:49,603 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,603 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:14:49,603 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 05:14:49,603 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:14:49,604 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 05:14:49,604 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,604 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 05:14:49,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:49,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:49,605 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:49,604 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,604 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:49,605 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 05:14:49,606 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 05:14:49,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:49,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:49,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:49,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,37993,1689138862265': 2023-07-12 05:14:49,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 05:14:49,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:49,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:49,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:49,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:49,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:49,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,38155,1689138862340': 2023-07-12 05:14:49,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 05:14:49,614 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 05:14:49,614 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:14:49,614 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:14:49,614 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,614 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:14:49,626 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,626 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,626 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,626 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,626 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:49,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,626 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:49,627 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,626 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:49,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:49,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:49,627 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:49,628 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:49,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,629 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,630 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:49,630 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,634 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:49,635 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:49,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:49,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:49,634 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,635 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:49,635 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:49,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:49,635 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:49,635 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:49,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:49,635 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:49,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:49,635 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:49,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:49,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 05:14:49,637 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:49,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:49,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:14:49,637 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:49,637 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,637 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,637 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,637 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,637 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,637 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,637 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 05:14:49,644 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:14:49,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 05:14:49,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:14:49,645 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:14:49,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,697 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 05:14:49,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,698 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 05:14:49,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689138889542Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689138889649 (+107 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689138889649Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689138889649Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689138889655 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689138889667 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689138889697 (+30 ms) 2023-07-12 05:14:49,701 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 05:14:49,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 158 msec 2023-07-12 05:14:49,846 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:14:49,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 05:14:49,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:14:49,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37993] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:14:49,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38155] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:14:49,857 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 05:14:49,857 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:49,857 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:14:49,871 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:14:49,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138889871 (current time:1689138889871). 2023-07-12 05:14:49,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:14:49,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x5e848ac6 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:49,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cf7046a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:49,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:49,880 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:49,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e848ac6 to 127.0.0.1:53723 2023-07-12 05:14:49,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:14:49,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x5d208ae7 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:14:49,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73887de0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:14:49,889 DEBUG [hconnection-0x2194d78b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:49,894 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:49,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:14:49,904 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:14:49,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d208ae7 to 127.0.0.1:53723 2023-07-12 05:14:49,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:14:49,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 05:14:49,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:14:49,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:14:49,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:14:49,912 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:14:49,913 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689139489913 2023-07-12 05:14:49,913 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 05:14:49,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:14:49,915 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:14:49,915 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:14:49,917 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:14:49,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 05:14:49,919 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-12 05:14:49,920 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 05:14:49,921 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689139489921 2023-07-12 05:14:49,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 05:14:49,935 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 05:14:49,935 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:49,937 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 05:14:49,937 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 05:14:49,937 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,937 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,938 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:49,938 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:49,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:49,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:49,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:49,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:49,938 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,938 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:49,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:49,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:49,938 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,938 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 05:14:49,939 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,939 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 05:14:49,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,940 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 05:14:49,940 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 05:14:49,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 05:14:49,940 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 05:14:49,940 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:49,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 05:14:49,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 05:14:49,944 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 05:14:49,944 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:49,944 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 05:14:49,945 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 05:14:49,945 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 05:14:49,944 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 05:14:49,945 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 05:14:49,945 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 05:14:49,945 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:14:49,946 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 05:14:49,947 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 05:14:49,947 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 05:14:49,947 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 05:14:49,952 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,953 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,953 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,953 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,953 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:49,953 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:49,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:49,953 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,953 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,954 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:49,954 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,954 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:14:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 05:14:49,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:49,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 05:14:49,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55359197[Count = 1] remaining members to acquire global barrier 2023-07-12 05:14:49,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:49,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:49,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:49,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:49,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 05:14:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:49,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 05:14:49,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55359197[Count = 0] remaining members to acquire global barrier 2023-07-12 05:14:49,957 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 05:14:49,957 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,958 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,958 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,958 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,958 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:49,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,958 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:14:49,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:49,959 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:49,959 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:14:49,959 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 05:14:49,959 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:14:49,959 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:14:49,959 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:14:49,959 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:14:49,959 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:14:49,959 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:14:49,959 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:14:49,959 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:49,959 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:14:49,959 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. started... 2023-07-12 05:14:49,959 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. started... 2023-07-12 05:14:49,959 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 442f86547c630e808e09d70df749736d 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 05:14:49,959 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 920c49acba8ab40728a437dfba6d7edd 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 05:14:49,960 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 05:14:49,960 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:49,960 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 05:14:49,991 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071255d8c3113f8f491ca6ade8212c747cd1 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071255d8c3113f8f491ca6ade8212c747cd1 2023-07-12 05:14:49,995 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071217391c61588c481fb016dcb7850f5770 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071217391c61588c481fb016dcb7850f5770 2023-07-12 05:14:50,007 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/.tmp/cf/c4a8f62475834b50b4ab607fa9b03c4c 2023-07-12 05:14:50,015 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/.tmp/cf/c4a8f62475834b50b4ab607fa9b03c4c as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/cf/c4a8f62475834b50b4ab607fa9b03c4c 2023-07-12 05:14:50,015 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:14:50,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 05:14:50,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:14:50,017 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:14:50,021 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/cf/c4a8f62475834b50b4ab607fa9b03c4c, entries=4, sequenceid=6, filesize=5.6 K 2023-07-12 05:14:50,023 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 442f86547c630e808e09d70df749736d in 64ms, sequenceid=6, compaction requested=false 2023-07-12 05:14:50,023 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 05:14:50,023 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 442f86547c630e808e09d70df749736d: 2023-07-12 05:14:50,024 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 05:14:50,024 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:14:50,024 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/cf/c4a8f62475834b50b4ab607fa9b03c4c] hfiles 2023-07-12 05:14:50,024 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/cf/c4a8f62475834b50b4ab607fa9b03c4c for snapshot=snaptb0-testExportFileSystemState 2023-07-12 05:14:50,027 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/.tmp/cf/aaacea96f3e843e88f46b918adab6d21 2023-07-12 05:14:50,033 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. completed. 2023-07-12 05:14:50,033 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:14:50,033 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:14:50,033 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:14:50,033 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,033 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 05:14:50,033 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:14:50,034 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/.tmp/cf/aaacea96f3e843e88f46b918adab6d21 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/cf/aaacea96f3e843e88f46b918adab6d21 2023-07-12 05:14:50,036 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 05:14:50,036 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:50,036 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,036 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 05:14:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:50,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:50,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 05:14:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:50,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:50,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 05:14:50,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,37993,1689138862265': 2023-07-12 05:14:50,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 05:14:50,043 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/cf/aaacea96f3e843e88f46b918adab6d21, entries=46, sequenceid=6, filesize=12.7 K 2023-07-12 05:14:50,044 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 920c49acba8ab40728a437dfba6d7edd in 85ms, sequenceid=6, compaction requested=false 2023-07-12 05:14:50,045 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 920c49acba8ab40728a437dfba6d7edd: 2023-07-12 05:14:50,045 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 05:14:50,045 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:14:50,046 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/cf/aaacea96f3e843e88f46b918adab6d21] hfiles 2023-07-12 05:14:50,046 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/cf/aaacea96f3e843e88f46b918adab6d21 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 05:14:50,055 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. completed. 2023-07-12 05:14:50,055 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:14:50,055 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:14:50,055 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:14:50,055 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,055 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 05:14:50,055 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:14:50,056 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 05:14:50,056 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,056 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:50,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:50,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:50,057 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 05:14:50,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:50,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:50,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 05:14:50,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:50,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:50,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 05:14:50,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:50,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,38155,1689138862340': 2023-07-12 05:14:50,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 05:14:50,062 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 05:14:50,062 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:14:50,062 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:14:50,062 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 05:14:50,062 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:14:50,064 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,064 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,064 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:50,064 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,064 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:50,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:50,064 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:50,064 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:14:50,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:14:50,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:50,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:50,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,064 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:50,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,065 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:50,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:14:50,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:50,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:50,065 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 05:14:50,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:14:50,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 05:14:50,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:50,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,066 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:14:50,067 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:50,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 05:14:50,067 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:50,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,069 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,069 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:50,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:50,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:50,070 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:50,070 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:50,070 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:14:50,070 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:50,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:50,070 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:50,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:50,070 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:50,070 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 05:14:50,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 05:14:50,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 05:14:50,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:14:50,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:14:50,070 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,070 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:14:50,070 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:14:50,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:50,071 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:14:50,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:14:50,073 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,073 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:14:50,073 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:14:50,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:50,073 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:50,073 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071217391c61588c481fb016dcb7850f5770, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071255d8c3113f8f491ca6ade8212c747cd1] mob files 2023-07-12 05:14:50,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071217391c61588c481fb016dcb7850f5770 2023-07-12 05:14:50,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:14:50,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071255d8c3113f8f491ca6ade8212c747cd1 2023-07-12 05:14:50,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:14:50,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 05:14:50,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 05:14:50,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,132 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689138889913Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689138890081 (+168 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689138890081Loading Region manifests for snaptb0-testExportFileSystemState at 1689138890081Writing data manifest for snaptb0-testExportFileSystemState at 1689138890087 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689138890099 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689138890132 (+33 ms) 2023-07-12 05:14:50,135 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 05:14:50,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 220 msec 2023-07-12 05:14:50,217 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:14:50,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 05:14:50,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:14:50,219 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138890219 2023-07-12 05:14:50,220 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:43005, tgtDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138890219, rawTgtDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138890219, srcFsUri=hdfs://localhost.localdomain:43005, srcDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:14:50,250 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:14:50,251 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1099986495_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138890219, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138890219/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,251 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b, snapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 05:14:50,274 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138890219/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 05:14:50,317 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,317 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,317 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,318 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,318 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,318 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,318 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,379 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/hadoop-423607758091515818.jar 2023-07-12 05:14:50,379 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,379 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,380 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,380 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,380 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,380 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 05:14:50,381 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 05:14:50,381 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 05:14:50,381 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 05:14:50,382 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 05:14:50,382 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 05:14:50,382 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 05:14:50,383 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 05:14:50,383 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 05:14:50,383 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 05:14:50,384 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 05:14:50,384 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:14:50,384 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:14:50,384 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:14:50,385 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:14:50,385 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:14:50,385 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:14:50,386 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:14:50,903 WARN [Listener at jenkins-hbase20.apache.org/34425] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 05:14:50,906 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 05:14:50,908 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 05:14:52,773 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:14:52,773 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:14:52,779 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0001_000001 (auth:SIMPLE) 2023-07-12 05:14:53,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0002_000001 (auth:SIMPLE) 2023-07-12 05:14:54,123 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 05:14:57,704 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0002_000001 (auth:SIMPLE) 2023-07-12 05:14:59,935 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0002_000001 (auth:SIMPLE) 2023-07-12 05:15:03,113 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0002_000001 (auth:SIMPLE) 2023-07-12 05:15:05,140 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 05:15:05,141 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 05:15:05,150 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 05:15:05,151 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 05:15:05,151 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 05:15:05,152 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 05:15:05,153 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 05:15:05,154 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 05:15:05,154 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138890219/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138890219/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 05:15:05,154 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138890219/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 05:15:05,154 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138890219/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 05:15:05,164 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 05:15:05,165 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemState 2023-07-12 05:15:05,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 05:15:05,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 05:15:05,173 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138905172"}]},"ts":"1689138905172"} 2023-07-12 05:15:05,179 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 05:15:05,180 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 05:15:05,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=442f86547c630e808e09d70df749736d, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=920c49acba8ab40728a437dfba6d7edd, UNASSIGN}] 2023-07-12 05:15:05,184 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=442f86547c630e808e09d70df749736d, UNASSIGN 2023-07-12 05:15:05,184 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=920c49acba8ab40728a437dfba6d7edd, UNASSIGN 2023-07-12 05:15:05,185 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=920c49acba8ab40728a437dfba6d7edd, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:05,185 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=442f86547c630e808e09d70df749736d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:05,185 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689138905185"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138905185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138905185"}]},"ts":"1689138905185"} 2023-07-12 05:15:05,185 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689138905185"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138905185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138905185"}]},"ts":"1689138905185"} 2023-07-12 05:15:05,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 920c49acba8ab40728a437dfba6d7edd, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:15:05,188 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 442f86547c630e808e09d70df749736d, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:15:05,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 05:15:05,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:15:05,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 920c49acba8ab40728a437dfba6d7edd, disabling compactions & flushes 2023-07-12 05:15:05,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 442f86547c630e808e09d70df749736d 2023-07-12 05:15:05,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:15:05,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:15:05,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 442f86547c630e808e09d70df749736d, disabling compactions & flushes 2023-07-12 05:15:05,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. after waiting 0 ms 2023-07-12 05:15:05,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:15:05,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:15:05,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:15:05,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. after waiting 0 ms 2023-07-12 05:15:05,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:15:05,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:15:05,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:15:05,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:15:05,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:15:05,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d. 2023-07-12 05:15:05,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd. 2023-07-12 05:15:05,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 442f86547c630e808e09d70df749736d: 2023-07-12 05:15:05,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 920c49acba8ab40728a437dfba6d7edd: 2023-07-12 05:15:05,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:15:05,364 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=920c49acba8ab40728a437dfba6d7edd, regionState=CLOSED 2023-07-12 05:15:05,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 442f86547c630e808e09d70df749736d 2023-07-12 05:15:05,364 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689138905363"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138905363"}]},"ts":"1689138905363"} 2023-07-12 05:15:05,364 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=442f86547c630e808e09d70df749736d, regionState=CLOSED 2023-07-12 05:15:05,364 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689138905364"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138905364"}]},"ts":"1689138905364"} 2023-07-12 05:15:05,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-12 05:15:05,368 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 920c49acba8ab40728a437dfba6d7edd, server=jenkins-hbase20.apache.org,38155,1689138862340 in 178 msec 2023-07-12 05:15:05,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-12 05:15:05,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 442f86547c630e808e09d70df749736d, server=jenkins-hbase20.apache.org,37993,1689138862265 in 179 msec 2023-07-12 05:15:05,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=920c49acba8ab40728a437dfba6d7edd, UNASSIGN in 186 msec 2023-07-12 05:15:05,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-12 05:15:05,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=442f86547c630e808e09d70df749736d, UNASSIGN in 187 msec 2023-07-12 05:15:05,371 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138905371"}]},"ts":"1689138905371"} 2023-07-12 05:15:05,373 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 05:15:05,374 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 05:15:05,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 210 msec 2023-07-12 05:15:05,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 05:15:05,476 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 05:15:05,478 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemState 2023-07-12 05:15:05,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 05:15:05,483 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 05:15:05,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 05:15:05,485 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 05:15:05,486 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 05:15:05,488 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 05:15:05,488 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 05:15:05,488 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 05:15:05,488 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 05:15:05,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 05:15:05,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 05:15:05,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 05:15:05,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 05:15:05,489 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 05:15:05,489 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 05:15:05,489 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 05:15:05,489 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 05:15:05,489 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:05,489 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:05,489 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:05,489 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:05,491 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d 2023-07-12 05:15:05,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 05:15:05,491 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:15:05,493 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/recovered.edits] 2023-07-12 05:15:05,493 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/recovered.edits] 2023-07-12 05:15:05,498 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/cf/aaacea96f3e843e88f46b918adab6d21 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/cf/aaacea96f3e843e88f46b918adab6d21 2023-07-12 05:15:05,498 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/cf/c4a8f62475834b50b4ab607fa9b03c4c to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/cf/c4a8f62475834b50b4ab607fa9b03c4c 2023-07-12 05:15:05,502 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd/recovered.edits/9.seqid 2023-07-12 05:15:05,502 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d/recovered.edits/9.seqid 2023-07-12 05:15:05,502 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/920c49acba8ab40728a437dfba6d7edd 2023-07-12 05:15:05,502 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemState/442f86547c630e808e09d70df749736d 2023-07-12 05:15:05,503 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 05:15:05,503 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 05:15:05,504 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-12 05:15:05,507 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071217391c61588c481fb016dcb7850f5770 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023071217391c61588c481fb016dcb7850f5770 2023-07-12 05:15:05,509 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071255d8c3113f8f491ca6ade8212c747cd1 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071255d8c3113f8f491ca6ade8212c747cd1 2023-07-12 05:15:05,509 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 05:15:05,512 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 05:15:05,515 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 05:15:05,518 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 05:15:05,520 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 05:15:05,520 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 05:15:05,520 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138905520"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:05,520 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138905520"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:05,523 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 05:15:05,523 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 442f86547c630e808e09d70df749736d, NAME => 'testtb-testExportFileSystemState,,1689138888857.442f86547c630e808e09d70df749736d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 920c49acba8ab40728a437dfba6d7edd, NAME => 'testtb-testExportFileSystemState,1,1689138888857.920c49acba8ab40728a437dfba6d7edd.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 05:15:05,523 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 05:15:05,523 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689138905523"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:05,525 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 05:15:05,527 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 05:15:05,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 49 msec 2023-07-12 05:15:05,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 05:15:05,593 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 05:15:05,607 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 05:15:05,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 05:15:05,610 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 05:15:05,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 05:15:05,644 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 751) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:42912 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:44928 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2142 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:41818 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36667302) connection to jenkins-hbase20.apache.org/148.251.75.209:39987 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36667302) connection to jenkins-hbase20.apache.org/148.251.75.209:34425 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_315618584_1 at /127.0.0.1:42888 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 932), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 239), ProcessCount=172 (was 172), AvailableMemoryMB=2266 (was 2627) 2023-07-12 05:15:05,645 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 05:15:05,662 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=213, ProcessCount=172, AvailableMemoryMB=2266 2023-07-12 05:15:05,662 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 05:15:05,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 05:15:05,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 05:15:05,669 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 05:15:05,669 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 05:15:05,670 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 05:15:05,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 05:15:05,672 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:05,673 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:05,673 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d empty. 2023-07-12 05:15:05,673 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9 empty. 2023-07-12 05:15:05,674 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:05,674 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:05,674 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 05:15:05,686 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 05:15:05,687 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => cc877f1aee20811a2a7b4b73464774b9, NAME => 'testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:15:05,687 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => e042aa92db8fa43317de60a2e891a37d, NAME => 'testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:15:05,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:05,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing cc877f1aee20811a2a7b4b73464774b9, disabling compactions & flushes 2023-07-12 05:15:05,699 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:05,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:05,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. after waiting 0 ms 2023-07-12 05:15:05,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:05,699 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:05,699 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for cc877f1aee20811a2a7b4b73464774b9: 2023-07-12 05:15:05,701 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:05,701 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing e042aa92db8fa43317de60a2e891a37d, disabling compactions & flushes 2023-07-12 05:15:05,701 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:05,701 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:05,701 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. after waiting 0 ms 2023-07-12 05:15:05,701 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:05,701 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:05,701 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for e042aa92db8fa43317de60a2e891a37d: 2023-07-12 05:15:05,704 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 05:15:05,704 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689138905704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138905704"}]},"ts":"1689138905704"} 2023-07-12 05:15:05,705 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689138905704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138905704"}]},"ts":"1689138905704"} 2023-07-12 05:15:05,707 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 05:15:05,707 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 05:15:05,708 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138905708"}]},"ts":"1689138905708"} 2023-07-12 05:15:05,709 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 05:15:05,711 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 05:15:05,712 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 05:15:05,712 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 05:15:05,712 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 05:15:05,713 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 05:15:05,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc877f1aee20811a2a7b4b73464774b9, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e042aa92db8fa43317de60a2e891a37d, ASSIGN}] 2023-07-12 05:15:05,716 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc877f1aee20811a2a7b4b73464774b9, ASSIGN 2023-07-12 05:15:05,716 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e042aa92db8fa43317de60a2e891a37d, ASSIGN 2023-07-12 05:15:05,717 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc877f1aee20811a2a7b4b73464774b9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40199,1689138862404; forceNewPlan=false, retain=false 2023-07-12 05:15:05,717 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e042aa92db8fa43317de60a2e891a37d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37993,1689138862265; forceNewPlan=false, retain=false 2023-07-12 05:15:05,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 05:15:05,867 INFO [jenkins-hbase20:36929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 05:15:05,870 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=e042aa92db8fa43317de60a2e891a37d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:05,871 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689138905870"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138905870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138905870"}]},"ts":"1689138905870"} 2023-07-12 05:15:05,870 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=cc877f1aee20811a2a7b4b73464774b9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:05,871 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689138905870"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138905870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138905870"}]},"ts":"1689138905870"} 2023-07-12 05:15:05,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure e042aa92db8fa43317de60a2e891a37d, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:15:05,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure cc877f1aee20811a2a7b4b73464774b9, server=jenkins-hbase20.apache.org,40199,1689138862404}] 2023-07-12 05:15:05,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 05:15:06,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:06,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e042aa92db8fa43317de60a2e891a37d, NAME => 'testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 05:15:06,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. service=AccessControlService 2023-07-12 05:15:06,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:15:06,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:06,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:06,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:06,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:06,034 INFO [StoreOpener-e042aa92db8fa43317de60a2e891a37d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:06,043 DEBUG [StoreOpener-e042aa92db8fa43317de60a2e891a37d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/cf 2023-07-12 05:15:06,043 DEBUG [StoreOpener-e042aa92db8fa43317de60a2e891a37d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/cf 2023-07-12 05:15:06,056 INFO [StoreOpener-e042aa92db8fa43317de60a2e891a37d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e042aa92db8fa43317de60a2e891a37d columnFamilyName cf 2023-07-12 05:15:06,060 INFO [StoreOpener-e042aa92db8fa43317de60a2e891a37d-1] regionserver.HStore(310): Store=e042aa92db8fa43317de60a2e891a37d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:15:06,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:06,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc877f1aee20811a2a7b4b73464774b9, NAME => 'testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 05:15:06,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. service=AccessControlService 2023-07-12 05:15:06,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:15:06,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:06,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:06,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:06,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:06,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:06,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:06,066 INFO [StoreOpener-cc877f1aee20811a2a7b4b73464774b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:06,068 DEBUG [StoreOpener-cc877f1aee20811a2a7b4b73464774b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/cf 2023-07-12 05:15:06,069 DEBUG [StoreOpener-cc877f1aee20811a2a7b4b73464774b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/cf 2023-07-12 05:15:06,069 INFO [StoreOpener-cc877f1aee20811a2a7b4b73464774b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc877f1aee20811a2a7b4b73464774b9 columnFamilyName cf 2023-07-12 05:15:06,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:06,071 INFO [StoreOpener-cc877f1aee20811a2a7b4b73464774b9-1] regionserver.HStore(310): Store=cc877f1aee20811a2a7b4b73464774b9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:15:06,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:06,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:06,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:15:06,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e042aa92db8fa43317de60a2e891a37d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63068124, jitterRate=-0.06021171808242798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:15:06,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e042aa92db8fa43317de60a2e891a37d: 2023-07-12 05:15:06,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d., pid=45, masterSystemTime=1689138906026 2023-07-12 05:15:06,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:06,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:06,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:06,087 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=e042aa92db8fa43317de60a2e891a37d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,087 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689138906087"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138906087"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138906087"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138906087"}]},"ts":"1689138906087"} 2023-07-12 05:15:06,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-12 05:15:06,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure e042aa92db8fa43317de60a2e891a37d, server=jenkins-hbase20.apache.org,37993,1689138862265 in 217 msec 2023-07-12 05:15:06,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e042aa92db8fa43317de60a2e891a37d, ASSIGN in 379 msec 2023-07-12 05:15:06,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:15:06,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cc877f1aee20811a2a7b4b73464774b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63922103, jitterRate=-0.04748643934726715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:15:06,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cc877f1aee20811a2a7b4b73464774b9: 2023-07-12 05:15:06,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9., pid=46, masterSystemTime=1689138906035 2023-07-12 05:15:06,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:06,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:06,102 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=cc877f1aee20811a2a7b4b73464774b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,103 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689138906102"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138906102"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138906102"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138906102"}]},"ts":"1689138906102"} 2023-07-12 05:15:06,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-12 05:15:06,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure cc877f1aee20811a2a7b4b73464774b9, server=jenkins-hbase20.apache.org,40199,1689138862404 in 231 msec 2023-07-12 05:15:06,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-12 05:15:06,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc877f1aee20811a2a7b4b73464774b9, ASSIGN in 400 msec 2023-07-12 05:15:06,118 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 05:15:06,118 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138906118"}]},"ts":"1689138906118"} 2023-07-12 05:15:06,121 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 05:15:06,125 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 05:15:06,126 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 05:15:06,129 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 05:15:06,134 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:06,134 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:06,134 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:06,134 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:06,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:06,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:06,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:06,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:06,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 472 msec 2023-07-12 05:15:06,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 05:15:06,277 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 05:15:06,279 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 05:15:06,279 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:06,282 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:15:06,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 05:15:06,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138906300 (current time:1689138906300). 2023-07-12 05:15:06,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:15:06,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x3133e23f to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:06,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34b835a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:06,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:06,312 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:06,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3133e23f to 127.0.0.1:53723 2023-07-12 05:15:06,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:06,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x55724ae0 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:06,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bfe686b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:06,326 DEBUG [hconnection-0xe9e77b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:06,330 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:06,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:06,339 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:06,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55724ae0 to 127.0.0.1:53723 2023-07-12 05:15:06,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:06,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 05:15:06,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:15:06,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 05:15:06,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 05:15:06,345 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 05:15:06,345 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689139506345 2023-07-12 05:15:06,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 05:15:06,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 05:15:06,347 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:15:06,347 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:15:06,348 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 05:15:06,351 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 05:15:06,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-12 05:15:06,355 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 05:15:06,357 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689139506357 2023-07-12 05:15:06,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,393 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 05:15:06,393 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:06,395 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 05:15:06,395 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 05:15:06,396 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,396 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,397 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,397 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,397 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,397 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,397 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,397 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,398 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,398 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:15:06,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 05:15:06,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 05:15:06,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,398 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 05:15:06,399 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 05:15:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 05:15:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,399 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 05:15:06,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,399 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 05:15:06,399 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:06,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,399 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 05:15:06,400 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:06,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,401 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 05:15:06,401 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 05:15:06,401 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 05:15:06,401 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 05:15:06,401 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 05:15:06,402 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 05:15:06,402 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 05:15:06,402 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:06,406 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 05:15:06,406 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 05:15:06,406 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 05:15:06,410 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,410 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,411 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:06,411 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,411 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,411 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:06,411 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,411 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:06,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:06,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:06,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 05:15:06,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@638191eb[Count = 1] remaining members to acquire global barrier 2023-07-12 05:15:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:06,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:06,414 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:06,415 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,415 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:06,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:06,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 05:15:06,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@638191eb[Count = 0] remaining members to acquire global barrier 2023-07-12 05:15:06,421 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 05:15:06,421 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,427 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,427 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,427 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,428 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,428 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 05:15:06,428 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,428 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:15:06,428 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 05:15:06,428 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 05:15:06,428 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:06,428 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:06,428 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 05:15:06,428 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:06,428 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:15:06,428 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. started... 2023-07-12 05:15:06,429 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc877f1aee20811a2a7b4b73464774b9: 2023-07-12 05:15:06,429 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,429 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:06,429 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:15:06,430 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:06,430 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:06,430 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:06,431 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. started... 2023-07-12 05:15:06,432 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e042aa92db8fa43317de60a2e891a37d: 2023-07-12 05:15:06,433 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,433 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:06,433 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:15:06,434 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 05:15:06,434 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:06,434 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 05:15:06,447 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:06,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 05:15:06,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:15:06,450 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:15:06,461 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. completed. 2023-07-12 05:15:06,461 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:06,462 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:06,462 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:06,462 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,462 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 05:15:06,462 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:15:06,463 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,463 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 05:15:06,463 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:06,464 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 05:15:06,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:06,466 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. completed. 2023-07-12 05:15:06,466 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:06,466 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:06,466 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:06,466 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,466 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 05:15:06,466 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:15:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:06,468 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,468 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 05:15:06,468 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:06,468 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 05:15:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,40199,1689138862404': 2023-07-12 05:15:06,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 05:15:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,37993,1689138862265': 2023-07-12 05:15:06,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 05:15:06,478 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 05:15:06,478 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:15:06,478 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:15:06,478 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,478 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:15:06,490 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 05:15:06,490 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,490 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,490 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,491 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:06,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:06,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,490 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,490 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,491 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:06,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,494 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:06,494 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,494 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:06,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,496 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,496 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,496 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,499 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,499 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,499 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,499 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,499 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,499 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:06,499 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,501 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,501 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,501 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,501 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,501 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,501 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,501 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,501 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,499 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,499 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,502 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,501 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 05:15:06,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:15:06,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 05:15:06,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 05:15:06,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,577 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:06,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689138906346Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689138906521 (+175 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689138906521Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689138906521Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689138906525 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689138906538 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689138906576 (+38 ms) 2023-07-12 05:15:06,580 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 05:15:06,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 233 msec 2023-07-12 05:15:06,651 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:06,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 05:15:06,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:15:06,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40199] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:15:06,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37993] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:15:06,662 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 05:15:06,662 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:06,662 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:15:06,674 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 05:15:06,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138906674 (current time:1689138906674). 2023-07-12 05:15:06,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:15:06,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x48e33f4b to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:06,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fa41399, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:06,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:06,691 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:06,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48e33f4b to 127.0.0.1:53723 2023-07-12 05:15:06,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:06,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x556574e2 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:06,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ad1062, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:06,702 DEBUG [hconnection-0x7b6af3b5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:06,703 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:06,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:06,709 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:06,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x556574e2 to 127.0.0.1:53723 2023-07-12 05:15:06,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:06,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 05:15:06,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:15:06,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 05:15:06,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 05:15:06,715 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 05:15:06,716 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689139506716 2023-07-12 05:15:06,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 05:15:06,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 05:15:06,719 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:15:06,719 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:15:06,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 05:15:06,720 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 05:15:06,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-12 05:15:06,723 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 05:15:06,724 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689139506724 2023-07-12 05:15:06,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 05:15:06,738 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 05:15:06,738 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:06,739 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 05:15:06,739 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 05:15:06,740 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,740 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,741 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,741 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,741 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,741 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,741 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,741 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 05:15:06,742 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 05:15:06,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 05:15:06,742 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:06,743 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 05:15:06,743 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 05:15:06,744 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:06,744 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:06,744 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 05:15:06,746 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 05:15:06,746 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 05:15:06,745 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 05:15:06,746 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 05:15:06,746 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 05:15:06,746 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,746 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 05:15:06,746 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 05:15:06,746 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 05:15:06,746 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:15:06,750 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,751 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:06,751 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,751 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,751 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,751 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:06,751 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:06,751 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,751 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:06,751 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,751 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:06,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 05:15:06,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:06,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 05:15:06,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4982bbcf[Count = 1] remaining members to acquire global barrier 2023-07-12 05:15:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 05:15:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:06,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 05:15:06,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4982bbcf[Count = 0] remaining members to acquire global barrier 2023-07-12 05:15:06,755 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 05:15:06,755 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,759 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,759 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,759 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,759 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 05:15:06,759 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 05:15:06,759 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,759 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 05:15:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 05:15:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:06,760 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:15:06,760 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:06,760 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:15:06,760 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:06,760 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:06,760 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. started... 2023-07-12 05:15:06,760 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. started... 2023-07-12 05:15:06,761 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc877f1aee20811a2a7b4b73464774b9 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-12 05:15:06,761 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e042aa92db8fa43317de60a2e891a37d 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-12 05:15:06,761 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 05:15:06,761 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:06,762 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 05:15:06,787 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712ff4e9ed061ce4fee8ac5859310110432 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712ff4e9ed061ce4fee8ac5859310110432 2023-07-12 05:15:06,799 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/.tmp/cf/c1187f62b3a04137b7e018ad665407ff 2023-07-12 05:15:06,800 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712034352b2627b4108886644fd98d0b68b to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230712034352b2627b4108886644fd98d0b68b 2023-07-12 05:15:06,809 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/.tmp/cf/c1187f62b3a04137b7e018ad665407ff as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/cf/c1187f62b3a04137b7e018ad665407ff 2023-07-12 05:15:06,815 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/cf/c1187f62b3a04137b7e018ad665407ff, entries=44, sequenceid=6, filesize=12.2 K 2023-07-12 05:15:06,816 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/.tmp/cf/fdf148d5028141f08e0d932e8b20bbc6 2023-07-12 05:15:06,816 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for e042aa92db8fa43317de60a2e891a37d in 56ms, sequenceid=6, compaction requested=false 2023-07-12 05:15:06,817 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e042aa92db8fa43317de60a2e891a37d: 2023-07-12 05:15:06,818 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 05:15:06,818 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:06,818 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/cf/c1187f62b3a04137b7e018ad665407ff] hfiles 2023-07-12 05:15:06,818 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/cf/c1187f62b3a04137b7e018ad665407ff for snapshot=snaptb0-testConsecutiveExports 2023-07-12 05:15:06,819 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:06,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 05:15:06,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:15:06,820 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:15:06,823 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/.tmp/cf/fdf148d5028141f08e0d932e8b20bbc6 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/cf/fdf148d5028141f08e0d932e8b20bbc6 2023-07-12 05:15:06,829 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. completed. 2023-07-12 05:15:06,829 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:06,829 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:06,829 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:06,829 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,829 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 05:15:06,829 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:15:06,829 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/cf/fdf148d5028141f08e0d932e8b20bbc6, entries=6, sequenceid=6, filesize=5.9 K 2023-07-12 05:15:06,830 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for cc877f1aee20811a2a7b4b73464774b9 in 70ms, sequenceid=6, compaction requested=false 2023-07-12 05:15:06,830 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,830 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 05:15:06,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,830 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:06,830 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc877f1aee20811a2a7b4b73464774b9: 2023-07-12 05:15:06,830 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 05:15:06,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:06,832 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 05:15:06,832 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:06,832 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/cf/fdf148d5028141f08e0d932e8b20bbc6] hfiles 2023-07-12 05:15:06,832 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/cf/fdf148d5028141f08e0d932e8b20bbc6 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 05:15:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 05:15:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 05:15:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,37993,1689138862265': 2023-07-12 05:15:06,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 05:15:06,841 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. completed. 2023-07-12 05:15:06,841 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:06,841 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:06,841 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:06,841 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,841 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 05:15:06,841 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:15:06,842 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 05:15:06,843 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,843 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:06,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:06,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:06,843 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 05:15:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 05:15:06,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:06,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 05:15:06,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,40199,1689138862404': 2023-07-12 05:15:06,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 05:15:06,848 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 05:15:06,848 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:15:06,848 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:15:06,848 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 05:15:06,848 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:15:06,849 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,849 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:06,849 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,849 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,849 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,850 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:06,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,850 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,850 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 05:15:06,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,851 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:06,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,851 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 05:15:06,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:06,853 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 05:15:06,853 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,853 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,863 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,863 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,863 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,863 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,863 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,863 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,863 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,864 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:06,863 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:06,864 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:06,863 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,865 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:06,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 05:15:06,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 05:15:06,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 05:15:06,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:15:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,865 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:06,866 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,866 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:06,866 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:06,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:06,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:06,866 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,866 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712ff4e9ed061ce4fee8ac5859310110432, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230712034352b2627b4108886644fd98d0b68b] mob files 2023-07-12 05:15:06,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712ff4e9ed061ce4fee8ac5859310110432 2023-07-12 05:15:06,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230712034352b2627b4108886644fd98d0b68b 2023-07-12 05:15:06,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 05:15:06,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,902 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 05:15:06,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,926 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 05:15:06,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689138906717Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689138906877 (+160 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689138906877Loading Region manifests for snaptb0-testConsecutiveExports at 1689138906877Writing data manifest for snaptb0-testConsecutiveExports at 1689138906883 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689138906895 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689138906926 (+31 ms) 2023-07-12 05:15:06,928 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 05:15:06,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 210 msec 2023-07-12 05:15:07,021 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:07,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 05:15:07,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:15:07,022 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022 2023-07-12 05:15:07,023 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022, srcFsUri=hdfs://localhost.localdomain:43005, srcDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:15:07,044 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:15:07,044 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@148fb94d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 05:15:07,044 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b, snapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 05:15:07,054 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 05:15:07,069 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,069 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,069 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,070 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,070 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,070 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,070 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,140 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/hadoop-901260455197965342.jar 2023-07-12 05:15:07,141 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,141 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,142 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,142 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,143 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,143 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:07,144 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 05:15:07,144 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 05:15:07,145 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 05:15:07,145 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 05:15:07,146 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 05:15:07,147 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 05:15:07,147 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 05:15:07,147 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 05:15:07,147 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 05:15:07,148 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 05:15:07,148 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:07,148 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:07,149 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:07,149 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:07,149 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:07,150 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:07,150 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:07,602 WARN [Listener at jenkins-hbase20.apache.org/34425] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 05:15:07,605 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 05:15:07,607 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 05:15:09,202 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:15:09,202 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:15:09,206 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0002_000001 (auth:SIMPLE) 2023-07-12 05:15:10,079 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0003_000001 (auth:SIMPLE) 2023-07-12 05:15:10,953 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 05:15:13,833 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0003_000001 (auth:SIMPLE) 2023-07-12 05:15:16,078 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0003_000001 (auth:SIMPLE) 2023-07-12 05:15:18,325 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0003_000001 (auth:SIMPLE) 2023-07-12 05:15:19,801 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 05:15:19,801 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 05:15:19,805 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 05:15:19,805 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 05:15:19,805 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 05:15:19,805 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 05:15:19,808 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 05:15:19,808 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 05:15:19,808 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2f334ffa in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 05:15:19,808 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 05:15:19,808 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 05:15:19,809 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022, srcFsUri=hdfs://localhost.localdomain:43005, srcDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:15:19,826 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:15:19,826 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@53f31287, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 05:15:19,826 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b, snapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 05:15:19,842 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 05:15:19,855 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,856 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,856 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,857 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,857 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,858 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,858 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,921 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/hadoop-1317528639599676794.jar 2023-07-12 05:15:19,922 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,922 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,922 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,923 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,923 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,923 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:19,924 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 05:15:19,924 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 05:15:19,924 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 05:15:19,925 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 05:15:19,925 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 05:15:19,925 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 05:15:19,926 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 05:15:19,926 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 05:15:19,926 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 05:15:19,926 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 05:15:19,927 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:19,927 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:19,927 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:19,928 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:19,928 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:19,928 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:19,928 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:20,806 WARN [Listener at jenkins-hbase20.apache.org/34425] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 05:15:20,808 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 05:15:20,811 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 05:15:24,627 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:15:24,627 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:15:24,631 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0003_000001 (auth:SIMPLE) 2023-07-12 05:15:25,227 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0004_000001 (auth:SIMPLE) 2023-07-12 05:15:29,118 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0004_000001 (auth:SIMPLE) 2023-07-12 05:15:31,337 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0004_000001 (auth:SIMPLE) 2023-07-12 05:15:33,630 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0004_000001 (auth:SIMPLE) 2023-07-12 05:15:35,093 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 05:15:35,093 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 05:15:35,097 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 05:15:35,097 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 05:15:35,097 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 05:15:35,097 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 05:15:35,100 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 05:15:35,101 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 05:15:35,101 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2f334ffa in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 05:15:35,101 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 05:15:35,101 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/local-export-1689138907022/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 05:15:35,113 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 05:15:35,114 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testConsecutiveExports 2023-07-12 05:15:35,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 05:15:35,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 05:15:35,119 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138935119"}]},"ts":"1689138935119"} 2023-07-12 05:15:35,120 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 05:15:35,135 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 05:15:35,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc877f1aee20811a2a7b4b73464774b9, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e042aa92db8fa43317de60a2e891a37d, UNASSIGN}] 2023-07-12 05:15:35,139 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc877f1aee20811a2a7b4b73464774b9, UNASSIGN 2023-07-12 05:15:35,140 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e042aa92db8fa43317de60a2e891a37d, UNASSIGN 2023-07-12 05:15:35,141 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=cc877f1aee20811a2a7b4b73464774b9, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:35,141 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=e042aa92db8fa43317de60a2e891a37d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:35,141 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689138935141"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138935141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138935141"}]},"ts":"1689138935141"} 2023-07-12 05:15:35,141 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689138935141"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138935141"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138935141"}]},"ts":"1689138935141"} 2023-07-12 05:15:35,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure cc877f1aee20811a2a7b4b73464774b9, server=jenkins-hbase20.apache.org,40199,1689138862404}] 2023-07-12 05:15:35,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure e042aa92db8fa43317de60a2e891a37d, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:15:35,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 05:15:35,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:35,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e042aa92db8fa43317de60a2e891a37d, disabling compactions & flushes 2023-07-12 05:15:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cc877f1aee20811a2a7b4b73464774b9, disabling compactions & flushes 2023-07-12 05:15:35,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:35,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. after waiting 0 ms 2023-07-12 05:15:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. after waiting 0 ms 2023-07-12 05:15:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:35,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:35,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:15:35,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:15:35,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:15:35,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:15:35,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d. 2023-07-12 05:15:35,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9. 2023-07-12 05:15:35,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e042aa92db8fa43317de60a2e891a37d: 2023-07-12 05:15:35,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cc877f1aee20811a2a7b4b73464774b9: 2023-07-12 05:15:35,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:35,316 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=cc877f1aee20811a2a7b4b73464774b9, regionState=CLOSED 2023-07-12 05:15:35,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:35,317 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689138935316"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138935316"}]},"ts":"1689138935316"} 2023-07-12 05:15:35,317 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=e042aa92db8fa43317de60a2e891a37d, regionState=CLOSED 2023-07-12 05:15:35,317 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689138935317"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138935317"}]},"ts":"1689138935317"} 2023-07-12 05:15:35,319 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-12 05:15:35,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure cc877f1aee20811a2a7b4b73464774b9, server=jenkins-hbase20.apache.org,40199,1689138862404 in 175 msec 2023-07-12 05:15:35,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-12 05:15:35,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure e042aa92db8fa43317de60a2e891a37d, server=jenkins-hbase20.apache.org,37993,1689138862265 in 175 msec 2023-07-12 05:15:35,320 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=cc877f1aee20811a2a7b4b73464774b9, UNASSIGN in 184 msec 2023-07-12 05:15:35,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-12 05:15:35,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e042aa92db8fa43317de60a2e891a37d, UNASSIGN in 184 msec 2023-07-12 05:15:35,322 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138935322"}]},"ts":"1689138935322"} 2023-07-12 05:15:35,323 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 05:15:35,324 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 05:15:35,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 211 msec 2023-07-12 05:15:35,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 05:15:35,421 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 05:15:35,423 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testConsecutiveExports 2023-07-12 05:15:35,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 05:15:35,427 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 05:15:35,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 05:15:35,428 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 05:15:35,431 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 05:15:35,433 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 05:15:35,433 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 05:15:35,433 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 05:15:35,433 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 05:15:35,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 05:15:35,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 05:15:35,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 05:15:35,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 05:15:35,434 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 05:15:35,435 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 05:15:35,435 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:35,435 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 05:15:35,435 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 05:15:35,435 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:35,435 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:35,435 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:35,435 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:35,436 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:35,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 05:15:35,438 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/recovered.edits] 2023-07-12 05:15:35,438 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/recovered.edits] 2023-07-12 05:15:35,444 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/cf/fdf148d5028141f08e0d932e8b20bbc6 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/cf/fdf148d5028141f08e0d932e8b20bbc6 2023-07-12 05:15:35,444 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/cf/c1187f62b3a04137b7e018ad665407ff to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/cf/c1187f62b3a04137b7e018ad665407ff 2023-07-12 05:15:35,447 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9/recovered.edits/9.seqid 2023-07-12 05:15:35,447 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d/recovered.edits/9.seqid 2023-07-12 05:15:35,447 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/cc877f1aee20811a2a7b4b73464774b9 2023-07-12 05:15:35,447 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testConsecutiveExports/e042aa92db8fa43317de60a2e891a37d 2023-07-12 05:15:35,448 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 05:15:35,448 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 05:15:35,449 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-12 05:15:35,453 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712ff4e9ed061ce4fee8ac5859310110432 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230712ff4e9ed061ce4fee8ac5859310110432 2023-07-12 05:15:35,454 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230712034352b2627b4108886644fd98d0b68b to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230712034352b2627b4108886644fd98d0b68b 2023-07-12 05:15:35,457 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 05:15:35,460 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 05:15:35,462 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 05:15:35,464 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 05:15:35,466 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 05:15:35,466 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 05:15:35,466 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138935466"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:35,466 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138935466"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:35,468 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 05:15:35,468 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cc877f1aee20811a2a7b4b73464774b9, NAME => 'testtb-testConsecutiveExports,,1689138905664.cc877f1aee20811a2a7b4b73464774b9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e042aa92db8fa43317de60a2e891a37d, NAME => 'testtb-testConsecutiveExports,1,1689138905664.e042aa92db8fa43317de60a2e891a37d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 05:15:35,468 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 05:15:35,468 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689138935468"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:35,472 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 05:15:35,474 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 05:15:35,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 51 msec 2023-07-12 05:15:35,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 05:15:35,538 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 05:15:35,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 05:15:35,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 05:15:35,561 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 05:15:35,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 05:15:35,592 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 763), OpenFileDescriptor=907 (was 932), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=196 (was 213), ProcessCount=169 (was 172), AvailableMemoryMB=1844 (was 2266) 2023-07-12 05:15:35,592 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-12 05:15:35,612 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=196, ProcessCount=169, AvailableMemoryMB=1844 2023-07-12 05:15:35,612 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-12 05:15:35,614 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 05:15:35,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:35,617 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 05:15:35,618 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 05:15:35,618 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 05:15:35,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 05:15:35,622 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:35,622 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:35,622 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091 empty. 2023-07-12 05:15:35,622 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3 empty. 2023-07-12 05:15:35,623 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:35,623 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:35,623 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 05:15:35,637 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 05:15:35,639 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8585634dd70a403e3262665a6dd11091, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:15:35,639 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 93b6b57f77e5cd06da550e5fe78f88d3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:15:35,651 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:35,651 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:35,651 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 93b6b57f77e5cd06da550e5fe78f88d3, disabling compactions & flushes 2023-07-12 05:15:35,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 8585634dd70a403e3262665a6dd11091, disabling compactions & flushes 2023-07-12 05:15:35,652 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:35,652 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:35,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:35,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:35,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. after waiting 0 ms 2023-07-12 05:15:35,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:35,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. after waiting 0 ms 2023-07-12 05:15:35,652 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:35,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:35,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 93b6b57f77e5cd06da550e5fe78f88d3: 2023-07-12 05:15:35,652 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:35,652 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 8585634dd70a403e3262665a6dd11091: 2023-07-12 05:15:35,655 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 05:15:35,656 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689138935656"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138935656"}]},"ts":"1689138935656"} 2023-07-12 05:15:35,656 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689138935656"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138935656"}]},"ts":"1689138935656"} 2023-07-12 05:15:35,667 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 05:15:35,668 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 05:15:35,668 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138935668"}]},"ts":"1689138935668"} 2023-07-12 05:15:35,670 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 05:15:35,672 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 05:15:35,673 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 05:15:35,673 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 05:15:35,673 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 05:15:35,673 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 05:15:35,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8585634dd70a403e3262665a6dd11091, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b6b57f77e5cd06da550e5fe78f88d3, ASSIGN}] 2023-07-12 05:15:35,676 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b6b57f77e5cd06da550e5fe78f88d3, ASSIGN 2023-07-12 05:15:35,676 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8585634dd70a403e3262665a6dd11091, ASSIGN 2023-07-12 05:15:35,677 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8585634dd70a403e3262665a6dd11091, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38155,1689138862340; forceNewPlan=false, retain=false 2023-07-12 05:15:35,677 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b6b57f77e5cd06da550e5fe78f88d3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37993,1689138862265; forceNewPlan=false, retain=false 2023-07-12 05:15:35,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 05:15:35,828 INFO [jenkins-hbase20:36929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 05:15:35,835 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=8585634dd70a403e3262665a6dd11091, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:35,835 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=93b6b57f77e5cd06da550e5fe78f88d3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:35,836 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689138935835"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138935835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138935835"}]},"ts":"1689138935835"} 2023-07-12 05:15:35,836 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689138935835"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138935835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138935835"}]},"ts":"1689138935835"} 2023-07-12 05:15:35,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 8585634dd70a403e3262665a6dd11091, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:15:35,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 93b6b57f77e5cd06da550e5fe78f88d3, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:15:35,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 05:15:35,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:35,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:35,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93b6b57f77e5cd06da550e5fe78f88d3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 05:15:35,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8585634dd70a403e3262665a6dd11091, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 05:15:35,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. service=AccessControlService 2023-07-12 05:15:35,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. service=AccessControlService 2023-07-12 05:15:35,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:15:35,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:15:35,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:35,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:35,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:35,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:35,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:35,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:35,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:35,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:36,000 INFO [StoreOpener-8585634dd70a403e3262665a6dd11091-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:36,000 INFO [StoreOpener-93b6b57f77e5cd06da550e5fe78f88d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:36,002 DEBUG [StoreOpener-8585634dd70a403e3262665a6dd11091-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/cf 2023-07-12 05:15:36,002 DEBUG [StoreOpener-93b6b57f77e5cd06da550e5fe78f88d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/cf 2023-07-12 05:15:36,002 DEBUG [StoreOpener-93b6b57f77e5cd06da550e5fe78f88d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/cf 2023-07-12 05:15:36,002 DEBUG [StoreOpener-8585634dd70a403e3262665a6dd11091-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/cf 2023-07-12 05:15:36,003 INFO [StoreOpener-8585634dd70a403e3262665a6dd11091-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8585634dd70a403e3262665a6dd11091 columnFamilyName cf 2023-07-12 05:15:36,003 INFO [StoreOpener-93b6b57f77e5cd06da550e5fe78f88d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93b6b57f77e5cd06da550e5fe78f88d3 columnFamilyName cf 2023-07-12 05:15:36,005 INFO [StoreOpener-8585634dd70a403e3262665a6dd11091-1] regionserver.HStore(310): Store=8585634dd70a403e3262665a6dd11091/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:15:36,005 INFO [StoreOpener-93b6b57f77e5cd06da550e5fe78f88d3-1] regionserver.HStore(310): Store=93b6b57f77e5cd06da550e5fe78f88d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:15:36,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:36,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:36,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:36,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:36,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:36,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:15:36,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 93b6b57f77e5cd06da550e5fe78f88d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73007186, jitterRate=0.0878918468952179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:15:36,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 93b6b57f77e5cd06da550e5fe78f88d3: 2023-07-12 05:15:36,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3., pid=61, masterSystemTime=1689138935990 2023-07-12 05:15:36,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:36,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:36,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:36,025 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=93b6b57f77e5cd06da550e5fe78f88d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,025 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689138936025"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138936025"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138936025"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138936025"}]},"ts":"1689138936025"} 2023-07-12 05:15:36,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:15:36,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8585634dd70a403e3262665a6dd11091; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64085480, jitterRate=-0.0450519323348999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:15:36,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8585634dd70a403e3262665a6dd11091: 2023-07-12 05:15:36,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091., pid=60, masterSystemTime=1689138935989 2023-07-12 05:15:36,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:36,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:36,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-12 05:15:36,030 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 93b6b57f77e5cd06da550e5fe78f88d3, server=jenkins-hbase20.apache.org,37993,1689138862265 in 190 msec 2023-07-12 05:15:36,030 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=8585634dd70a403e3262665a6dd11091, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,030 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689138936030"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138936030"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138936030"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138936030"}]},"ts":"1689138936030"} 2023-07-12 05:15:36,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b6b57f77e5cd06da550e5fe78f88d3, ASSIGN in 356 msec 2023-07-12 05:15:36,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-12 05:15:36,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 8585634dd70a403e3262665a6dd11091, server=jenkins-hbase20.apache.org,38155,1689138862340 in 194 msec 2023-07-12 05:15:36,035 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-12 05:15:36,035 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8585634dd70a403e3262665a6dd11091, ASSIGN in 359 msec 2023-07-12 05:15:36,036 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 05:15:36,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138936036"}]},"ts":"1689138936036"} 2023-07-12 05:15:36,038 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 05:15:36,042 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 05:15:36,071 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 05:15:36,074 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 05:15:36,075 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:36,075 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:36,075 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:36,075 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:36,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:36,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:36,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:36,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:36,081 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 463 msec 2023-07-12 05:15:36,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 05:15:36,224 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 05:15:36,227 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,227 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:36,229 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:15:36,242 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 05:15:36,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138936242 (current time:1689138936242). 2023-07-12 05:15:36,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:15:36,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x364ba107 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:36,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@428b684a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:36,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:36,252 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:36,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x364ba107 to 127.0.0.1:53723 2023-07-12 05:15:36,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:36,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x57797b2d to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:36,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cd1bb5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:36,261 DEBUG [hconnection-0x25014db4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:36,264 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:36,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:36,272 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:36,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57797b2d to 127.0.0.1:53723 2023-07-12 05:15:36,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:36,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 05:15:36,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:15:36,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 05:15:36,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 05:15:36,279 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 05:15:36,280 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689139536280 2023-07-12 05:15:36,280 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 05:15:36,282 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:15:36,282 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:15:36,284 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 05:15:36,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 05:15:36,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-12 05:15:36,287 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 05:15:36,288 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689139536288 2023-07-12 05:15:36,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,299 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 05:15:36,299 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:36,300 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 05:15:36,300 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 05:15:36,300 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,300 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,301 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,301 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,301 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,301 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,301 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,301 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,302 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,302 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 05:15:36,302 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 05:15:36,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,303 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 05:15:36,303 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:36,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,304 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 05:15:36,304 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 05:15:36,304 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:36,303 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 05:15:36,305 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 05:15:36,305 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 05:15:36,304 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 05:15:36,305 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 05:15:36,305 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:36,305 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 05:15:36,306 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 05:15:36,306 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 05:15:36,306 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 05:15:36,316 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,316 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:36,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:36,323 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,323 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,323 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:36,323 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,323 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:36,323 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,323 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:36,323 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,323 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:36,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:36,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 05:15:36,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2acfd266[Count = 1] remaining members to acquire global barrier 2023-07-12 05:15:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:36,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 05:15:36,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2acfd266[Count = 0] remaining members to acquire global barrier 2023-07-12 05:15:36,330 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 05:15:36,330 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,333 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,333 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,333 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,333 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 05:15:36,334 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 05:15:36,334 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:15:36,333 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,334 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 05:15:36,334 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 05:15:36,334 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,334 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:15:36,334 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:36,334 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:36,334 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:36,334 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:36,335 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:36,335 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. started... 2023-07-12 05:15:36,335 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:36,335 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. started... 2023-07-12 05:15:36,337 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93b6b57f77e5cd06da550e5fe78f88d3: 2023-07-12 05:15:36,337 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8585634dd70a403e3262665a6dd11091: 2023-07-12 05:15:36,337 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,337 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,337 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:36,337 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:36,337 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 05:15:36,337 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:36,337 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 05:15:36,337 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:15:36,337 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:15:36,350 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. completed. 2023-07-12 05:15:36,350 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. completed. 2023-07-12 05:15:36,350 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:36,350 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:36,350 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:36,350 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:36,350 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:36,350 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:36,350 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,350 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,350 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 05:15:36,350 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 05:15:36,350 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:15:36,350 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:15:36,352 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 05:15:36,352 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,352 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:36,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:36,354 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 05:15:36,354 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:36,352 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 05:15:36,354 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 05:15:36,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:36,354 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:36,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:36,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:36,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,37993,1689138862265': 2023-07-12 05:15:36,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 05:15:36,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:36,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:36,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:36,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:36,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:36,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38155,1689138862340': 2023-07-12 05:15:36,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 05:15:36,366 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 05:15:36,366 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:15:36,366 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:15:36,366 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,366 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:15:36,374 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,374 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,374 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,374 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,374 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,374 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:36,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,375 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,375 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,376 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:36,376 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,378 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:36,378 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,378 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,384 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:36,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 05:15:36,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:15:36,385 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:15:36,389 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,389 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,389 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,389 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,389 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,389 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:36,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,389 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,389 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,389 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,391 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,391 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:15:36,391 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 05:15:36,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,442 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 05:15:36,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,443 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689138936280Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689138936403 (+123 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689138936403Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689138936403Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689138936408 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689138936419 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689138936442 (+23 ms) 2023-07-12 05:15:36,445 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 05:15:36,446 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 163 msec 2023-07-12 05:15:36,492 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 05:15:36,585 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:36,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 05:15:36,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:15:36,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38155] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:15:36,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37993] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:15:36,594 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,594 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:36,595 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:15:36,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 05:15:36,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138936606 (current time:1689138936606). 2023-07-12 05:15:36,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:15:36,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x2895ca11 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:36,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7328c44, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:36,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:36,620 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:36,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2895ca11 to 127.0.0.1:53723 2023-07-12 05:15:36,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:36,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x645d8c42 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:36,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@629e079a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:36,634 DEBUG [hconnection-0x715df721-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:36,640 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:36,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:36,652 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:36,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x645d8c42 to 127.0.0.1:53723 2023-07-12 05:15:36,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:36,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 05:15:36,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:15:36,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 05:15:36,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 05:15:36,662 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 05:15:36,663 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689139536663 2023-07-12 05:15:36,663 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 05:15:36,665 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:15:36,665 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:15:36,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 05:15:36,667 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 05:15:36,669 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-12 05:15:36,670 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 05:15:36,671 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689139536671 2023-07-12 05:15:36,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,690 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 05:15:36,690 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:36,691 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 05:15:36,691 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 05:15:36,692 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,692 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,693 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,693 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,693 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,693 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,693 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,693 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,694 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,694 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:15:36,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 05:15:36,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 05:15:36,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 05:15:36,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 05:15:36,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,695 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 05:15:36,695 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 05:15:36,695 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:36,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,696 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 05:15:36,696 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 05:15:36,695 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:36,696 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 05:15:36,697 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 05:15:36,697 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 05:15:36,697 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 05:15:36,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 05:15:36,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,697 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 05:15:36,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,698 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 05:15:36,698 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:36,699 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 05:15:36,699 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 05:15:36,699 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 05:15:36,699 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,699 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:36,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:36,699 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,699 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,699 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,699 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:36,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:36,699 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,699 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:36,700 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:36,700 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,700 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:36,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:36,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 05:15:36,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@530f4781[Count = 1] remaining members to acquire global barrier 2023-07-12 05:15:36,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:36,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:36,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:36,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:36,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:36,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 05:15:36,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@530f4781[Count = 0] remaining members to acquire global barrier 2023-07-12 05:15:36,703 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 05:15:36,703 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,703 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,703 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,703 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,704 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 05:15:36,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,704 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,704 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 05:15:36,704 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:36,704 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:36,704 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:36,704 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:36,704 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 05:15:36,704 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,704 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:15:36,704 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:36,704 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:36,704 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. started... 2023-07-12 05:15:36,704 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 05:15:36,704 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. started... 2023-07-12 05:15:36,704 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:15:36,705 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8585634dd70a403e3262665a6dd11091 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 05:15:36,705 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 93b6b57f77e5cd06da550e5fe78f88d3 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 05:15:36,705 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 05:15:36,705 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:36,706 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 05:15:36,733 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071261ba7fd1103b4028ac4540797ed98d8e to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071261ba7fd1103b4028ac4540797ed98d8e 2023-07-12 05:15:36,734 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712a6651e8448374e3bb642d3df275a3e11 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712a6651e8448374e3bb642d3df275a3e11 2023-07-12 05:15:36,742 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/.tmp/cf/f7dba3061ce84afba50a68ce3df9649e 2023-07-12 05:15:36,742 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/.tmp/cf/c9e821555f5041edaecb24459aab8705 2023-07-12 05:15:36,747 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/.tmp/cf/c9e821555f5041edaecb24459aab8705 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/cf/c9e821555f5041edaecb24459aab8705 2023-07-12 05:15:36,747 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/.tmp/cf/f7dba3061ce84afba50a68ce3df9649e as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/cf/f7dba3061ce84afba50a68ce3df9649e 2023-07-12 05:15:36,752 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/cf/f7dba3061ce84afba50a68ce3df9649e, entries=47, sequenceid=6, filesize=13.5 K 2023-07-12 05:15:36,752 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/cf/c9e821555f5041edaecb24459aab8705, entries=3, sequenceid=6, filesize=5.4 K 2023-07-12 05:15:36,753 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 93b6b57f77e5cd06da550e5fe78f88d3 in 48ms, sequenceid=6, compaction requested=false 2023-07-12 05:15:36,753 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 8585634dd70a403e3262665a6dd11091 in 48ms, sequenceid=6, compaction requested=false 2023-07-12 05:15:36,755 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8585634dd70a403e3262665a6dd11091: 2023-07-12 05:15:36,755 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,756 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:36,756 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/cf/c9e821555f5041edaecb24459aab8705] hfiles 2023-07-12 05:15:36,756 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/cf/c9e821555f5041edaecb24459aab8705 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,756 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 93b6b57f77e5cd06da550e5fe78f88d3: 2023-07-12 05:15:36,756 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,756 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:36,756 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/cf/f7dba3061ce84afba50a68ce3df9649e] hfiles 2023-07-12 05:15:36,756 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/cf/f7dba3061ce84afba50a68ce3df9649e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,765 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:36,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 05:15:36,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:15:36,767 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:15:36,772 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. completed. 2023-07-12 05:15:36,772 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:36,772 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:36,772 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:36,772 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,772 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 05:15:36,772 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:15:36,773 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,773 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 05:15:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:36,774 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. completed. 2023-07-12 05:15:36,774 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:36,774 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:36,775 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:36,775 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:36,775 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,774 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 05:15:36,775 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 05:15:36,776 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:15:36,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:36,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:36,777 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,777 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 05:15:36,778 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:36,778 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 05:15:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:36,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38155,1689138862340': 2023-07-12 05:15:36,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 05:15:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,37993,1689138862265': 2023-07-12 05:15:36,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 05:15:36,790 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 05:15:36,790 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:15:36,790 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:15:36,790 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,790 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:15:36,806 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,806 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,806 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,806 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,806 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,806 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,807 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,806 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,808 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:36,808 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:36,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,810 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,810 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:36,810 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:36,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:36,815 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:36,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:15:36,817 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:36,815 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:36,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,817 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:36,817 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,817 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:36,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:36,817 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,817 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712a6651e8448374e3bb642d3df275a3e11, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071261ba7fd1103b4028ac4540797ed98d8e] mob files 2023-07-12 05:15:36,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712a6651e8448374e3bb642d3df275a3e11 2023-07-12 05:15:36,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071261ba7fd1103b4028ac4540797ed98d8e 2023-07-12 05:15:36,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,884 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 05:15:36,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,885 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:36,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689138936663Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689138936829 (+166 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689138936829Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689138936829Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689138936836 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689138936851 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689138936884 (+33 ms) 2023-07-12 05:15:36,887 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 05:15:36,889 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 222 msec 2023-07-12 05:15:36,967 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:36,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 05:15:36,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:15:36,994 DEBUG [Listener at jenkins-hbase20.apache.org/34425] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 05:15:36,998 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 05:15:37,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37993] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 05:15:37,001 DEBUG [Listener at jenkins-hbase20.apache.org/34425] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 05:15:37,004 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 05:15:37,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38155] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 05:15:37,005 DEBUG [Listener at jenkins-hbase20.apache.org/34425] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 05:15:37,010 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 05:15:37,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40199] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 05:15:37,013 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 05:15:37,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:37,017 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 05:15:37,017 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 05:15:37,017 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 05:15:37,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 05:15:37,020 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:37,020 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,020 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca empty. 2023-07-12 05:15:37,020 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9 empty. 2023-07-12 05:15:37,021 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:37,021 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,021 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 05:15:37,029 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 05:15:37,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => fb3602c1245288538503c2bf85418eb9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:15:37,030 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a65924b0613e796b66186e476bcaaaca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a65924b0613e796b66186e476bcaaaca, disabling compactions & flushes 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing fb3602c1245288538503c2bf85418eb9, disabling compactions & flushes 2023-07-12 05:15:37,037 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. 2023-07-12 05:15:37,037 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. after waiting 0 ms 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. after waiting 0 ms 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. 2023-07-12 05:15:37,037 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. 2023-07-12 05:15:37,037 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a65924b0613e796b66186e476bcaaaca: 2023-07-12 05:15:37,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for fb3602c1245288538503c2bf85418eb9: 2023-07-12 05:15:37,039 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 05:15:37,040 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689138937040"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138937040"}]},"ts":"1689138937040"} 2023-07-12 05:15:37,040 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689138937040"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138937040"}]},"ts":"1689138937040"} 2023-07-12 05:15:37,042 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 05:15:37,042 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 05:15:37,042 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138937042"}]},"ts":"1689138937042"} 2023-07-12 05:15:37,044 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 05:15:37,045 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 05:15:37,046 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 05:15:37,046 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 05:15:37,046 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 05:15:37,046 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 05:15:37,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a65924b0613e796b66186e476bcaaaca, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb3602c1245288538503c2bf85418eb9, ASSIGN}] 2023-07-12 05:15:37,049 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb3602c1245288538503c2bf85418eb9, ASSIGN 2023-07-12 05:15:37,049 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a65924b0613e796b66186e476bcaaaca, ASSIGN 2023-07-12 05:15:37,050 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb3602c1245288538503c2bf85418eb9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38155,1689138862340; forceNewPlan=false, retain=false 2023-07-12 05:15:37,050 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a65924b0613e796b66186e476bcaaaca, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37993,1689138862265; forceNewPlan=false, retain=false 2023-07-12 05:15:37,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 05:15:37,200 INFO [jenkins-hbase20:36929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 05:15:37,204 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=fb3602c1245288538503c2bf85418eb9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:37,204 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a65924b0613e796b66186e476bcaaaca, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:37,204 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689138937204"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138937204"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138937204"}]},"ts":"1689138937204"} 2023-07-12 05:15:37,204 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689138937204"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138937204"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138937204"}]},"ts":"1689138937204"} 2023-07-12 05:15:37,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure fb3602c1245288538503c2bf85418eb9, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:15:37,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure a65924b0613e796b66186e476bcaaaca, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:15:37,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 05:15:37,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. 2023-07-12 05:15:37,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. 2023-07-12 05:15:37,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a65924b0613e796b66186e476bcaaaca, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 05:15:37,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb3602c1245288538503c2bf85418eb9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 05:15:37,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. service=AccessControlService 2023-07-12 05:15:37,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. service=AccessControlService 2023-07-12 05:15:37,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:15:37,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:15:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:37,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,369 INFO [StoreOpener-fb3602c1245288538503c2bf85418eb9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,369 INFO [StoreOpener-a65924b0613e796b66186e476bcaaaca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:37,370 DEBUG [StoreOpener-fb3602c1245288538503c2bf85418eb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/cf 2023-07-12 05:15:37,370 DEBUG [StoreOpener-fb3602c1245288538503c2bf85418eb9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/cf 2023-07-12 05:15:37,371 DEBUG [StoreOpener-a65924b0613e796b66186e476bcaaaca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/cf 2023-07-12 05:15:37,371 DEBUG [StoreOpener-a65924b0613e796b66186e476bcaaaca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/cf 2023-07-12 05:15:37,371 INFO [StoreOpener-fb3602c1245288538503c2bf85418eb9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb3602c1245288538503c2bf85418eb9 columnFamilyName cf 2023-07-12 05:15:37,371 INFO [StoreOpener-a65924b0613e796b66186e476bcaaaca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a65924b0613e796b66186e476bcaaaca columnFamilyName cf 2023-07-12 05:15:37,372 INFO [StoreOpener-fb3602c1245288538503c2bf85418eb9-1] regionserver.HStore(310): Store=fb3602c1245288538503c2bf85418eb9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:15:37,372 INFO [StoreOpener-a65924b0613e796b66186e476bcaaaca-1] regionserver.HStore(310): Store=a65924b0613e796b66186e476bcaaaca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:15:37,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:37,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:37,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:37,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:15:37,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:15:37,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a65924b0613e796b66186e476bcaaaca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61364018, jitterRate=-0.08560487627983093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:15:37,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fb3602c1245288538503c2bf85418eb9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67797053, jitterRate=0.010254815220832825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:15:37,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a65924b0613e796b66186e476bcaaaca: 2023-07-12 05:15:37,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fb3602c1245288538503c2bf85418eb9: 2023-07-12 05:15:37,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9., pid=69, masterSystemTime=1689138937360 2023-07-12 05:15:37,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca., pid=70, masterSystemTime=1689138937362 2023-07-12 05:15:37,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. 2023-07-12 05:15:37,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. 2023-07-12 05:15:37,381 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=fb3602c1245288538503c2bf85418eb9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:37,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. 2023-07-12 05:15:37,381 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689138937381"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138937381"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138937381"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138937381"}]},"ts":"1689138937381"} 2023-07-12 05:15:37,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. 2023-07-12 05:15:37,382 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a65924b0613e796b66186e476bcaaaca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:37,382 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689138937381"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138937381"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138937381"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138937381"}]},"ts":"1689138937381"} 2023-07-12 05:15:37,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-12 05:15:37,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure fb3602c1245288538503c2bf85418eb9, server=jenkins-hbase20.apache.org,38155,1689138862340 in 176 msec 2023-07-12 05:15:37,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-12 05:15:37,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure a65924b0613e796b66186e476bcaaaca, server=jenkins-hbase20.apache.org,37993,1689138862265 in 175 msec 2023-07-12 05:15:37,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb3602c1245288538503c2bf85418eb9, ASSIGN in 337 msec 2023-07-12 05:15:37,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-12 05:15:37,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a65924b0613e796b66186e476bcaaaca, ASSIGN in 337 msec 2023-07-12 05:15:37,386 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 05:15:37,386 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138937386"}]},"ts":"1689138937386"} 2023-07-12 05:15:37,387 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 05:15:37,389 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 05:15:37,390 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 05:15:37,391 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 05:15:37,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:37,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:37,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:37,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:37,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:37,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:37,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:37,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:37,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:37,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:37,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:37,394 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:37,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 380 msec 2023-07-12 05:15:37,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 05:15:37,622 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 05:15:37,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$2(1952): Client=jenkins//148.251.75.209 merge regions a65924b0613e796b66186e476bcaaaca, fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a65924b0613e796b66186e476bcaaaca, fb3602c1245288538503c2bf85418eb9], force=true 2023-07-12 05:15:37,655 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a65924b0613e796b66186e476bcaaaca, fb3602c1245288538503c2bf85418eb9], force=true 2023-07-12 05:15:37,655 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a65924b0613e796b66186e476bcaaaca, fb3602c1245288538503c2bf85418eb9], force=true 2023-07-12 05:15:37,655 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a65924b0613e796b66186e476bcaaaca, fb3602c1245288538503c2bf85418eb9], force=true 2023-07-12 05:15:37,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 05:15:37,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a65924b0613e796b66186e476bcaaaca, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb3602c1245288538503c2bf85418eb9, UNASSIGN}] 2023-07-12 05:15:37,681 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a65924b0613e796b66186e476bcaaaca, UNASSIGN 2023-07-12 05:15:37,681 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb3602c1245288538503c2bf85418eb9, UNASSIGN 2023-07-12 05:15:37,681 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fb3602c1245288538503c2bf85418eb9, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:37,681 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a65924b0613e796b66186e476bcaaaca, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:37,682 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689138937681"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138937681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138937681"}]},"ts":"1689138937681"} 2023-07-12 05:15:37,682 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689138937681"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138937681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138937681"}]},"ts":"1689138937681"} 2023-07-12 05:15:37,683 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure a65924b0613e796b66186e476bcaaaca, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:15:37,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure fb3602c1245288538503c2bf85418eb9, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:15:37,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 05:15:37,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:37,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a65924b0613e796b66186e476bcaaaca, disabling compactions & flushes 2023-07-12 05:15:37,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. 2023-07-12 05:15:37,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. 2023-07-12 05:15:37,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. after waiting 0 ms 2023-07-12 05:15:37,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. 2023-07-12 05:15:37,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing a65924b0613e796b66186e476bcaaaca 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 05:15:37,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fb3602c1245288538503c2bf85418eb9, disabling compactions & flushes 2023-07-12 05:15:37,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. 2023-07-12 05:15:37,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. 2023-07-12 05:15:37,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. after waiting 0 ms 2023-07-12 05:15:37,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. 2023-07-12 05:15:37,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing fb3602c1245288538503c2bf85418eb9 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 05:15:37,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/.tmp/cf/88b0184c08c842a3b9c8f4bc66b7b220 2023-07-12 05:15:37,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/.tmp/cf/d05280bb67704296974862b9d14bac5c 2023-07-12 05:15:37,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/.tmp/cf/88b0184c08c842a3b9c8f4bc66b7b220 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/cf/88b0184c08c842a3b9c8f4bc66b7b220 2023-07-12 05:15:37,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/.tmp/cf/d05280bb67704296974862b9d14bac5c as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/cf/d05280bb67704296974862b9d14bac5c 2023-07-12 05:15:37,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/cf/d05280bb67704296974862b9d14bac5c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 05:15:37,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/cf/88b0184c08c842a3b9c8f4bc66b7b220, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 05:15:37,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for fb3602c1245288538503c2bf85418eb9 in 21ms, sequenceid=5, compaction requested=false 2023-07-12 05:15:37,859 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a65924b0613e796b66186e476bcaaaca in 22ms, sequenceid=5, compaction requested=false 2023-07-12 05:15:37,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 05:15:37,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 05:15:37,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 05:15:37,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 05:15:37,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:15:37,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9. 2023-07-12 05:15:37,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fb3602c1245288538503c2bf85418eb9: 2023-07-12 05:15:37,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:37,874 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=fb3602c1245288538503c2bf85418eb9, regionState=CLOSED 2023-07-12 05:15:37,874 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689138937874"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138937874"}]},"ts":"1689138937874"} 2023-07-12 05:15:37,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:15:37,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca. 2023-07-12 05:15:37,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a65924b0613e796b66186e476bcaaaca: 2023-07-12 05:15:37,879 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a65924b0613e796b66186e476bcaaaca, regionState=CLOSED 2023-07-12 05:15:37,880 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689138937879"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138937879"}]},"ts":"1689138937879"} 2023-07-12 05:15:37,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-12 05:15:37,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure fb3602c1245288538503c2bf85418eb9, server=jenkins-hbase20.apache.org,38155,1689138862340 in 193 msec 2023-07-12 05:15:37,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:37,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb3602c1245288538503c2bf85418eb9, UNASSIGN in 202 msec 2023-07-12 05:15:37,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-12 05:15:37,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure a65924b0613e796b66186e476bcaaaca, server=jenkins-hbase20.apache.org,37993,1689138862265 in 199 msec 2023-07-12 05:15:37,888 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-12 05:15:37,888 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a65924b0613e796b66186e476bcaaaca, UNASSIGN in 209 msec 2023-07-12 05:15:37,931 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 05:15:37,933 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937013.a65924b0613e796b66186e476bcaaaca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:37,933 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689138937013.fb3602c1245288538503c2bf85418eb9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:37,933 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:37,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 05:15:37,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e2a784dd1d92fdd4ce4a66bee0b1c70, ASSIGN}] 2023-07-12 05:15:37,978 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e2a784dd1d92fdd4ce4a66bee0b1c70, ASSIGN 2023-07-12 05:15:37,979 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e2a784dd1d92fdd4ce4a66bee0b1c70, ASSIGN; state=MERGED, location=jenkins-hbase20.apache.org,37993,1689138862265; forceNewPlan=false, retain=false 2023-07-12 05:15:38,129 INFO [jenkins-hbase20:36929] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 05:15:38,131 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3e2a784dd1d92fdd4ce4a66bee0b1c70, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,131 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689138938131"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138938131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138938131"}]},"ts":"1689138938131"} 2023-07-12 05:15:38,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 3e2a784dd1d92fdd4ce4a66bee0b1c70, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:15:38,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 05:15:38,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. 2023-07-12 05:15:38,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e2a784dd1d92fdd4ce4a66bee0b1c70, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70.', STARTKEY => '', ENDKEY => ''} 2023-07-12 05:15:38,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. service=AccessControlService 2023-07-12 05:15:38,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:15:38,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 3e2a784dd1d92fdd4ce4a66bee0b1c70 2023-07-12 05:15:38,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:38,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3e2a784dd1d92fdd4ce4a66bee0b1c70 2023-07-12 05:15:38,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3e2a784dd1d92fdd4ce4a66bee0b1c70 2023-07-12 05:15:38,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/.regioninfo 2023-07-12 05:15:38,299 INFO [StoreOpener-3e2a784dd1d92fdd4ce4a66bee0b1c70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3e2a784dd1d92fdd4ce4a66bee0b1c70 2023-07-12 05:15:38,300 DEBUG [StoreOpener-3e2a784dd1d92fdd4ce4a66bee0b1c70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf 2023-07-12 05:15:38,300 DEBUG [StoreOpener-3e2a784dd1d92fdd4ce4a66bee0b1c70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf 2023-07-12 05:15:38,301 INFO [StoreOpener-3e2a784dd1d92fdd4ce4a66bee0b1c70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e2a784dd1d92fdd4ce4a66bee0b1c70 columnFamilyName cf 2023-07-12 05:15:38,329 DEBUG [StoreOpener-3e2a784dd1d92fdd4ce4a66bee0b1c70-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf/88b0184c08c842a3b9c8f4bc66b7b220.fb3602c1245288538503c2bf85418eb9->hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/cf/88b0184c08c842a3b9c8f4bc66b7b220-top 2023-07-12 05:15:38,337 DEBUG [StoreOpener-3e2a784dd1d92fdd4ce4a66bee0b1c70-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf/d05280bb67704296974862b9d14bac5c.a65924b0613e796b66186e476bcaaaca->hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/cf/d05280bb67704296974862b9d14bac5c-top 2023-07-12 05:15:38,337 INFO [StoreOpener-3e2a784dd1d92fdd4ce4a66bee0b1c70-1] regionserver.HStore(310): Store=3e2a784dd1d92fdd4ce4a66bee0b1c70/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:15:38,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70 2023-07-12 05:15:38,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70 2023-07-12 05:15:38,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3e2a784dd1d92fdd4ce4a66bee0b1c70 2023-07-12 05:15:38,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3e2a784dd1d92fdd4ce4a66bee0b1c70; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67915381, jitterRate=0.01201803982257843}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:15:38,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3e2a784dd1d92fdd4ce4a66bee0b1c70: 2023-07-12 05:15:38,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70., pid=77, masterSystemTime=1689138938284 2023-07-12 05:15:38,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70.,because compaction is disabled. 2023-07-12 05:15:38,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. 2023-07-12 05:15:38,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. 2023-07-12 05:15:38,348 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3e2a784dd1d92fdd4ce4a66bee0b1c70, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,348 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689138938347"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138938347"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138938347"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138938347"}]},"ts":"1689138938347"} 2023-07-12 05:15:38,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 05:15:38,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 3e2a784dd1d92fdd4ce4a66bee0b1c70, server=jenkins-hbase20.apache.org,37993,1689138862265 in 216 msec 2023-07-12 05:15:38,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 05:15:38,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e2a784dd1d92fdd4ce4a66bee0b1c70, ASSIGN in 374 msec 2023-07-12 05:15:38,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a65924b0613e796b66186e476bcaaaca, fb3602c1245288538503c2bf85418eb9], force=true in 704 msec 2023-07-12 05:15:38,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 05:15:38,763 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 05:15:38,764 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 05:15:38,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138938764 (current time:1689138938764). 2023-07-12 05:15:38,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:15:38,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x059820cc to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:38,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e19ec90, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:38,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:38,778 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:38,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x059820cc to 127.0.0.1:53723 2023-07-12 05:15:38,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:38,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x2d229c29 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:38,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69784701, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:38,788 DEBUG [hconnection-0x58b44bd2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:38,791 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:38,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:38,800 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:38,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d229c29 to 127.0.0.1:53723 2023-07-12 05:15:38,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:38,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 05:15:38,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:15:38,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 05:15:38,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 05:15:38,805 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 05:15:38,806 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689139538806 2023-07-12 05:15:38,806 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 05:15:38,810 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:15:38,810 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:15:38,812 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 05:15:38,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 05:15:38,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-12 05:15:38,816 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 05:15:38,817 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689139538817 2023-07-12 05:15:38,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,831 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 05:15:38,831 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:38,833 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 05:15:38,833 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 05:15:38,834 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,834 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,835 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:38,835 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:38,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:38,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:38,835 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,835 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:38,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,835 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,835 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:15:38,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 05:15:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 05:15:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 05:15:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 05:15:38,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 05:15:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,839 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 05:15:38,839 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 05:15:38,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,839 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 05:15:38,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,839 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:38,839 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 05:15:38,841 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 05:15:38,839 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:38,841 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 05:15:38,841 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:38,843 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 05:15:38,843 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 05:15:38,844 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 05:15:38,844 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 05:15:38,844 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 05:15:38,845 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 05:15:38,845 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 05:15:38,850 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,850 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,850 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,850 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,850 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,850 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:38,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:38,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:38,850 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,850 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:38,850 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,850 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:38,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:38,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:38,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:38,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:38,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:38,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 05:15:38,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c6e8ac2[Count = 0] remaining members to acquire global barrier 2023-07-12 05:15:38,852 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 05:15:38,852 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,853 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,853 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,853 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,853 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 05:15:38,853 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,853 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:15:38,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,853 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 05:15:38,853 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 05:15:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,853 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 05:15:38,853 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:15:38,853 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:15:38,853 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 05:15:38,854 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:38,854 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:38,854 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. 2023-07-12 05:15:38,854 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. started... 2023-07-12 05:15:38,855 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e2a784dd1d92fdd4ce4a66bee0b1c70: 2023-07-12 05:15:38,855 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 05:15:38,855 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:38,855 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 05:15:38,857 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,857 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:38,857 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 05:15:38,857 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:38,857 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 05:15:38,860 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf/88b0184c08c842a3b9c8f4bc66b7b220.fb3602c1245288538503c2bf85418eb9->hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/cf/88b0184c08c842a3b9c8f4bc66b7b220-top, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf/d05280bb67704296974862b9d14bac5c.a65924b0613e796b66186e476bcaaaca->hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/cf/d05280bb67704296974862b9d14bac5c-top] hfiles 2023-07-12 05:15:38,860 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf/88b0184c08c842a3b9c8f4bc66b7b220.fb3602c1245288538503c2bf85418eb9 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,861 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf/d05280bb67704296974862b9d14bac5c.a65924b0613e796b66186e476bcaaaca for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,868 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. completed. 2023-07-12 05:15:38,868 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. 2023-07-12 05:15:38,868 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:38,868 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:38,868 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,869 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 05:15:38,869 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:15:38,875 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 05:15:38,875 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,875 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:38,875 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 05:15:38,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:38,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:38,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:38,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:38,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase20.apache.org,37993,1689138862265': 2023-07-12 05:15:38,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 05:15:38,879 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 05:15:38,879 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:15:38,879 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:15:38,879 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,879 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:15:38,883 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,883 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,883 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,883 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:38,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,883 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:38,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,883 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:38,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,883 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:38,883 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:38,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:38,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:38,884 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,884 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:38,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:38,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:38,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,887 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:38,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:38,887 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:38,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:38,888 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,891 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,892 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:38,891 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:38,891 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:38,892 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:38,892 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:38,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:38,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:38,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:38,892 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:38,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:38,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:38,892 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:38,892 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:38,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:38,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:38,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,892 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:38,892 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:38,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:38,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:38,892 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,892 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:38,893 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,893 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:38,893 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:38,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:38,893 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:38,893 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,912 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:38,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 05:15:38,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:15:38,913 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:15:38,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,941 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 05:15:38,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,942 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:38,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689138938806Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689138938892 (+86 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689138938892Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689138938895 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689138938906 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689138938941 (+35 ms) 2023-07-12 05:15:38,945 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 05:15:38,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 136 msec 2023-07-12 05:15:39,113 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:39,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 05:15:39,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:15:39,115 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138939115 2023-07-12 05:15:39,115 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:43005, tgtDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138939115, rawTgtDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138939115, srcFsUri=hdfs://localhost.localdomain:43005, srcDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:15:39,133 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:15:39,133 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-261065258_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138939115, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138939115/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:39,133 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b, snapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 05:15:39,143 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138939115/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:39,160 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,160 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,161 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,161 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,161 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,161 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,161 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,224 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/hadoop-5241056364864394050.jar 2023-07-12 05:15:39,224 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,225 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,225 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,225 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,225 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,226 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:39,226 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 05:15:39,226 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 05:15:39,227 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 05:15:39,227 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 05:15:39,227 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 05:15:39,228 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 05:15:39,228 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 05:15:39,228 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 05:15:39,229 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 05:15:39,229 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 05:15:39,229 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:39,230 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:39,230 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:39,230 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:39,230 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:39,231 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:39,231 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:39,631 WARN [Listener at jenkins-hbase20.apache.org/34425] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 05:15:39,634 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 05:15:39,636 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 05:15:39,803 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:15:39,804 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:15:39,807 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0004_000001 (auth:SIMPLE) 2023-07-12 05:15:40,640 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0005_000001 (auth:SIMPLE) 2023-07-12 05:15:40,894 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 05:15:46,130 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0005_000001 (auth:SIMPLE) 2023-07-12 05:15:48,442 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0005_000001 (auth:SIMPLE) 2023-07-12 05:15:51,343 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0005_000001 (auth:SIMPLE) 2023-07-12 05:15:52,927 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 05:15:52,928 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 05:15:52,950 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:52,950 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 05:15:52,950 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 05:15:52,950 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:52,951 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 05:15:52,951 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 05:15:52,951 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138939115/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138939115/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:52,952 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138939115/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 05:15:52,952 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138939115/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 05:15:52,959 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:52,959 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:52,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:52,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 05:15:52,967 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138952967"}]},"ts":"1689138952967"} 2023-07-12 05:15:52,969 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 05:15:52,970 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 05:15:52,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e2a784dd1d92fdd4ce4a66bee0b1c70, UNASSIGN}] 2023-07-12 05:15:52,974 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e2a784dd1d92fdd4ce4a66bee0b1c70, UNASSIGN 2023-07-12 05:15:52,975 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3e2a784dd1d92fdd4ce4a66bee0b1c70, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:52,976 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689138952975"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138952975"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138952975"}]},"ts":"1689138952975"} 2023-07-12 05:15:52,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 3e2a784dd1d92fdd4ce4a66bee0b1c70, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:15:53,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 05:15:53,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 3e2a784dd1d92fdd4ce4a66bee0b1c70 2023-07-12 05:15:53,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3e2a784dd1d92fdd4ce4a66bee0b1c70, disabling compactions & flushes 2023-07-12 05:15:53,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. 2023-07-12 05:15:53,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. 2023-07-12 05:15:53,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. after waiting 0 ms 2023-07-12 05:15:53,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. 2023-07-12 05:15:53,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 05:15:53,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:15:53,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70. 2023-07-12 05:15:53,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3e2a784dd1d92fdd4ce4a66bee0b1c70: 2023-07-12 05:15:53,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 3e2a784dd1d92fdd4ce4a66bee0b1c70 2023-07-12 05:15:53,154 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3e2a784dd1d92fdd4ce4a66bee0b1c70, regionState=CLOSED 2023-07-12 05:15:53,154 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689138953154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138953154"}]},"ts":"1689138953154"} 2023-07-12 05:15:53,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 05:15:53,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 3e2a784dd1d92fdd4ce4a66bee0b1c70, server=jenkins-hbase20.apache.org,37993,1689138862265 in 177 msec 2023-07-12 05:15:53,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 05:15:53,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3e2a784dd1d92fdd4ce4a66bee0b1c70, UNASSIGN in 188 msec 2023-07-12 05:15:53,162 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138953162"}]},"ts":"1689138953162"} 2023-07-12 05:15:53,164 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 05:15:53,165 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 05:15:53,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 206 msec 2023-07-12 05:15:53,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 05:15:53,269 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 05:15:53,270 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,274 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,275 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,278 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,279 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70 2023-07-12 05:15:53,279 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:53,279 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:53,280 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,280 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,280 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,280 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 05:15:53,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 05:15:53,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 05:15:53,281 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 05:15:53,282 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/recovered.edits] 2023-07-12 05:15:53,282 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/recovered.edits] 2023-07-12 05:15:53,282 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/recovered.edits] 2023-07-12 05:15:53,290 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf/88b0184c08c842a3b9c8f4bc66b7b220.fb3602c1245288538503c2bf85418eb9 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf/88b0184c08c842a3b9c8f4bc66b7b220.fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:53,290 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/cf/88b0184c08c842a3b9c8f4bc66b7b220 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/cf/88b0184c08c842a3b9c8f4bc66b7b220 2023-07-12 05:15:53,291 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/cf/d05280bb67704296974862b9d14bac5c to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/cf/d05280bb67704296974862b9d14bac5c 2023-07-12 05:15:53,292 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf/d05280bb67704296974862b9d14bac5c.a65924b0613e796b66186e476bcaaaca to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/cf/d05280bb67704296974862b9d14bac5c.a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:53,297 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/recovered.edits/12.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70/recovered.edits/12.seqid 2023-07-12 05:15:53,297 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,297 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,297 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:53,297 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,297 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:53,297 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:53,297 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,297 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:53,298 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3e2a784dd1d92fdd4ce4a66bee0b1c70 2023-07-12 05:15:53,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:53,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:53,300 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/recovered.edits/8.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9/recovered.edits/8.seqid 2023-07-12 05:15:53,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:53,301 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb3602c1245288538503c2bf85418eb9 2023-07-12 05:15:53,302 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/recovered.edits/8.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca/recovered.edits/8.seqid 2023-07-12 05:15:53,302 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a65924b0613e796b66186e476bcaaaca 2023-07-12 05:15:53,302 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 05:15:53,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 05:15:53,305 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:53,306 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,319 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 05:15:53,324 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 05:15:53,326 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,326 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 05:15:53,326 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138953326"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:53,331 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 05:15:53,331 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3e2a784dd1d92fdd4ce4a66bee0b1c70, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689138937014.3e2a784dd1d92fdd4ce4a66bee0b1c70.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 05:15:53,331 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 05:15:53,332 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689138953331"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:53,334 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 05:15:53,335 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 65 msec 2023-07-12 05:15:53,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 05:15:53,406 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 05:15:53,407 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,407 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 05:15:53,412 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138953412"}]},"ts":"1689138953412"} 2023-07-12 05:15:53,413 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 05:15:53,414 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 05:15:53,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8585634dd70a403e3262665a6dd11091, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b6b57f77e5cd06da550e5fe78f88d3, UNASSIGN}] 2023-07-12 05:15:53,420 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8585634dd70a403e3262665a6dd11091, UNASSIGN 2023-07-12 05:15:53,421 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b6b57f77e5cd06da550e5fe78f88d3, UNASSIGN 2023-07-12 05:15:53,421 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=93b6b57f77e5cd06da550e5fe78f88d3, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:53,421 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=8585634dd70a403e3262665a6dd11091, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:53,422 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689138953421"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138953421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138953421"}]},"ts":"1689138953421"} 2023-07-12 05:15:53,422 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689138953421"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138953421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138953421"}]},"ts":"1689138953421"} 2023-07-12 05:15:53,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 8585634dd70a403e3262665a6dd11091, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:15:53,425 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 93b6b57f77e5cd06da550e5fe78f88d3, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:15:53,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 05:15:53,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:53,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8585634dd70a403e3262665a6dd11091, disabling compactions & flushes 2023-07-12 05:15:53,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:53,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:53,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. after waiting 0 ms 2023-07-12 05:15:53,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:53,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:53,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 93b6b57f77e5cd06da550e5fe78f88d3, disabling compactions & flushes 2023-07-12 05:15:53,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:53,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:53,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. after waiting 0 ms 2023-07-12 05:15:53,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:53,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:15:53,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:15:53,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3. 2023-07-12 05:15:53,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 93b6b57f77e5cd06da550e5fe78f88d3: 2023-07-12 05:15:53,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:15:53,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:15:53,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091. 2023-07-12 05:15:53,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8585634dd70a403e3262665a6dd11091: 2023-07-12 05:15:53,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:53,614 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=93b6b57f77e5cd06da550e5fe78f88d3, regionState=CLOSED 2023-07-12 05:15:53,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:53,614 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689138953614"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138953614"}]},"ts":"1689138953614"} 2023-07-12 05:15:53,615 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=8585634dd70a403e3262665a6dd11091, regionState=CLOSED 2023-07-12 05:15:53,615 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689138953615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138953615"}]},"ts":"1689138953615"} 2023-07-12 05:15:53,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-12 05:15:53,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 93b6b57f77e5cd06da550e5fe78f88d3, server=jenkins-hbase20.apache.org,37993,1689138862265 in 193 msec 2023-07-12 05:15:53,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-12 05:15:53,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 8585634dd70a403e3262665a6dd11091, server=jenkins-hbase20.apache.org,38155,1689138862340 in 194 msec 2023-07-12 05:15:53,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=93b6b57f77e5cd06da550e5fe78f88d3, UNASSIGN in 203 msec 2023-07-12 05:15:53,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-12 05:15:53,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8585634dd70a403e3262665a6dd11091, UNASSIGN in 205 msec 2023-07-12 05:15:53,623 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138953623"}]},"ts":"1689138953623"} 2023-07-12 05:15:53,625 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 05:15:53,627 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 05:15:53,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 222 msec 2023-07-12 05:15:53,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 05:15:53,715 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 05:15:53,716 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,720 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,722 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,723 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,724 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,724 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,724 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,725 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 05:15:53,725 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 05:15:53,725 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 05:15:53,726 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,725 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,725 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,726 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:53,726 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:53,726 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:53,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 05:15:53,726 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,726 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:53,727 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-12 05:15:53,727 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:53,727 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:53,727 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 05:15:53,729 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/recovered.edits] 2023-07-12 05:15:53,729 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/recovered.edits] 2023-07-12 05:15:53,734 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/cf/f7dba3061ce84afba50a68ce3df9649e to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/cf/f7dba3061ce84afba50a68ce3df9649e 2023-07-12 05:15:53,734 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/cf/c9e821555f5041edaecb24459aab8705 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/cf/c9e821555f5041edaecb24459aab8705 2023-07-12 05:15:53,737 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3/recovered.edits/9.seqid 2023-07-12 05:15:53,737 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091/recovered.edits/9.seqid 2023-07-12 05:15:53,738 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/93b6b57f77e5cd06da550e5fe78f88d3 2023-07-12 05:15:53,738 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8585634dd70a403e3262665a6dd11091 2023-07-12 05:15:53,738 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 05:15:53,738 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 05:15:53,739 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-12 05:15:53,743 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712a6651e8448374e3bb642d3df275a3e11 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712a6651e8448374e3bb642d3df275a3e11 2023-07-12 05:15:53,744 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071261ba7fd1103b4028ac4540797ed98d8e to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071261ba7fd1103b4028ac4540797ed98d8e 2023-07-12 05:15:53,744 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 05:15:53,746 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,749 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 05:15:53,751 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 05:15:53,752 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,752 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 05:15:53,752 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138953752"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:53,752 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138953752"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:53,755 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 05:15:53,755 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8585634dd70a403e3262665a6dd11091, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689138935613.8585634dd70a403e3262665a6dd11091.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 93b6b57f77e5cd06da550e5fe78f88d3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689138935613.93b6b57f77e5cd06da550e5fe78f88d3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 05:15:53,755 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 05:15:53,756 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689138953756"}]},"ts":"9223372036854775807"} 2023-07-12 05:15:53,763 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 05:15:53,765 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,766 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 49 msec 2023-07-12 05:15:53,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 05:15:53,828 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 05:15:53,843 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 05:15:53,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,847 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 05:15:53,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 05:15:53,851 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 05:15:53,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 05:15:53,880 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 749) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:43834 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4221 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:37138 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36667302) connection to jenkins-hbase20.apache.org/148.251.75.209:40675 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:41052 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1058169941_1 at /127.0.0.1:41024 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1058169941_1 at /127.0.0.1:37100 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 907), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=358 (was 196) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=1095 (was 1844) 2023-07-12 05:15:53,880 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-12 05:15:53,904 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=358, ProcessCount=171, AvailableMemoryMB=1094 2023-07-12 05:15:53,905 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-12 05:15:53,907 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 05:15:53,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 05:15:53,913 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 05:15:53,913 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 05:15:53,914 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 05:15:53,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 05:15:53,922 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:15:53,922 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:15:53,923 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80 empty. 2023-07-12 05:15:53,923 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112 empty. 2023-07-12 05:15:53,923 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:15:53,923 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:15:53,923 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 05:15:53,944 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 05:15:53,946 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 089d852c23ce9d42f4c777a6e1b9f112, NAME => 'testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:15:53,951 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e2bbfbcdf82fb9349c3c2ce1e7d40b80, NAME => 'testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:15:53,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:53,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 089d852c23ce9d42f4c777a6e1b9f112, disabling compactions & flushes 2023-07-12 05:15:53,983 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:53,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:53,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. after waiting 0 ms 2023-07-12 05:15:53,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:53,983 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:53,983 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 089d852c23ce9d42f4c777a6e1b9f112: 2023-07-12 05:15:53,987 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:53,988 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e2bbfbcdf82fb9349c3c2ce1e7d40b80, disabling compactions & flushes 2023-07-12 05:15:53,988 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:15:53,988 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:15:53,988 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. after waiting 0 ms 2023-07-12 05:15:53,988 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:15:53,988 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:15:53,988 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e2bbfbcdf82fb9349c3c2ce1e7d40b80: 2023-07-12 05:15:53,993 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 05:15:53,994 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689138953994"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138953994"}]},"ts":"1689138953994"} 2023-07-12 05:15:53,994 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689138953994"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138953994"}]},"ts":"1689138953994"} 2023-07-12 05:15:53,997 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 05:15:53,998 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 05:15:53,998 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138953998"}]},"ts":"1689138953998"} 2023-07-12 05:15:54,000 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 05:15:54,002 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 05:15:54,004 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 05:15:54,004 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 05:15:54,004 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 05:15:54,004 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 05:15:54,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=089d852c23ce9d42f4c777a6e1b9f112, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2bbfbcdf82fb9349c3c2ce1e7d40b80, ASSIGN}] 2023-07-12 05:15:54,007 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=089d852c23ce9d42f4c777a6e1b9f112, ASSIGN 2023-07-12 05:15:54,007 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2bbfbcdf82fb9349c3c2ce1e7d40b80, ASSIGN 2023-07-12 05:15:54,008 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=089d852c23ce9d42f4c777a6e1b9f112, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38155,1689138862340; forceNewPlan=false, retain=false 2023-07-12 05:15:54,008 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2bbfbcdf82fb9349c3c2ce1e7d40b80, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40199,1689138862404; forceNewPlan=false, retain=false 2023-07-12 05:15:54,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 05:15:54,158 INFO [jenkins-hbase20:36929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 05:15:54,161 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e2bbfbcdf82fb9349c3c2ce1e7d40b80, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,161 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=089d852c23ce9d42f4c777a6e1b9f112, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,161 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689138954161"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138954161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138954161"}]},"ts":"1689138954161"} 2023-07-12 05:15:54,161 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689138954161"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138954161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138954161"}]},"ts":"1689138954161"} 2023-07-12 05:15:54,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure e2bbfbcdf82fb9349c3c2ce1e7d40b80, server=jenkins-hbase20.apache.org,40199,1689138862404}] 2023-07-12 05:15:54,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 089d852c23ce9d42f4c777a6e1b9f112, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:15:54,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 05:15:54,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:54,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 089d852c23ce9d42f4c777a6e1b9f112, NAME => 'testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 05:15:54,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. service=AccessControlService 2023-07-12 05:15:54,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:15:54,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:15:54,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:54,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:15:54,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:15:54,329 INFO [StoreOpener-089d852c23ce9d42f4c777a6e1b9f112-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:15:54,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:15:54,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e2bbfbcdf82fb9349c3c2ce1e7d40b80, NAME => 'testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 05:15:54,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. service=AccessControlService 2023-07-12 05:15:54,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:15:54,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:15:54,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:15:54,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:15:54,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:15:54,335 DEBUG [StoreOpener-089d852c23ce9d42f4c777a6e1b9f112-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/cf 2023-07-12 05:15:54,335 DEBUG [StoreOpener-089d852c23ce9d42f4c777a6e1b9f112-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/cf 2023-07-12 05:15:54,336 INFO [StoreOpener-089d852c23ce9d42f4c777a6e1b9f112-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 089d852c23ce9d42f4c777a6e1b9f112 columnFamilyName cf 2023-07-12 05:15:54,338 INFO [StoreOpener-089d852c23ce9d42f4c777a6e1b9f112-1] regionserver.HStore(310): Store=089d852c23ce9d42f4c777a6e1b9f112/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:15:54,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:15:54,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:15:54,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:15:54,343 INFO [StoreOpener-e2bbfbcdf82fb9349c3c2ce1e7d40b80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:15:54,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:15:54,344 DEBUG [StoreOpener-e2bbfbcdf82fb9349c3c2ce1e7d40b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/cf 2023-07-12 05:15:54,345 DEBUG [StoreOpener-e2bbfbcdf82fb9349c3c2ce1e7d40b80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/cf 2023-07-12 05:15:54,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 089d852c23ce9d42f4c777a6e1b9f112; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64353283, jitterRate=-0.04106135666370392}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:15:54,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 089d852c23ce9d42f4c777a6e1b9f112: 2023-07-12 05:15:54,345 INFO [StoreOpener-e2bbfbcdf82fb9349c3c2ce1e7d40b80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2bbfbcdf82fb9349c3c2ce1e7d40b80 columnFamilyName cf 2023-07-12 05:15:54,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112., pid=94, masterSystemTime=1689138954315 2023-07-12 05:15:54,346 INFO [StoreOpener-e2bbfbcdf82fb9349c3c2ce1e7d40b80-1] regionserver.HStore(310): Store=e2bbfbcdf82fb9349c3c2ce1e7d40b80/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:15:54,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:15:54,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:15:54,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:54,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:54,348 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=089d852c23ce9d42f4c777a6e1b9f112, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,349 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689138954348"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138954348"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138954348"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138954348"}]},"ts":"1689138954348"} 2023-07-12 05:15:54,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:15:54,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-12 05:15:54,354 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 089d852c23ce9d42f4c777a6e1b9f112, server=jenkins-hbase20.apache.org,38155,1689138862340 in 186 msec 2023-07-12 05:15:54,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=089d852c23ce9d42f4c777a6e1b9f112, ASSIGN in 350 msec 2023-07-12 05:15:54,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:15:54,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e2bbfbcdf82fb9349c3c2ce1e7d40b80; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65786793, jitterRate=-0.019700393080711365}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:15:54,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e2bbfbcdf82fb9349c3c2ce1e7d40b80: 2023-07-12 05:15:54,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80., pid=93, masterSystemTime=1689138954315 2023-07-12 05:15:54,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:15:54,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:15:54,359 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=e2bbfbcdf82fb9349c3c2ce1e7d40b80, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,360 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689138954359"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138954359"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138954359"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138954359"}]},"ts":"1689138954359"} 2023-07-12 05:15:54,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-12 05:15:54,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure e2bbfbcdf82fb9349c3c2ce1e7d40b80, server=jenkins-hbase20.apache.org,40199,1689138862404 in 198 msec 2023-07-12 05:15:54,365 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-12 05:15:54,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2bbfbcdf82fb9349c3c2ce1e7d40b80, ASSIGN in 360 msec 2023-07-12 05:15:54,366 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 05:15:54,366 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138954366"}]},"ts":"1689138954366"} 2023-07-12 05:15:54,368 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 05:15:54,369 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 05:15:54,370 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 05:15:54,372 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 05:15:54,373 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:54,373 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:54,373 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:54,373 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:15:54,374 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:54,374 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:54,374 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:54,374 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 05:15:54,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 467 msec 2023-07-12 05:15:54,498 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 05:15:54,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 05:15:54,519 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 05:15:54,521 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 05:15:54,521 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:54,523 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:15:54,538 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:15:54,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138954538 (current time:1689138954538). 2023-07-12 05:15:54,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:15:54,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x6ad07974 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:54,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62c60343, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:54,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:54,556 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:54,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ad07974 to 127.0.0.1:53723 2023-07-12 05:15:54,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:54,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x043fd814 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:54,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d4d1a3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:54,579 DEBUG [hconnection-0x3f43d0cf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:54,581 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:54,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:54,591 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:54,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x043fd814 to 127.0.0.1:53723 2023-07-12 05:15:54,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:54,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 05:15:54,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:15:54,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:15:54,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:15:54,599 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:15:54,600 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689139554600 2023-07-12 05:15:54,600 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 05:15:54,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:15:54,602 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:15:54,603 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:15:54,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 05:15:54,605 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:15:54,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-12 05:15:54,616 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 05:15:54,617 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689139554617 2023-07-12 05:15:54,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,671 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 05:15:54,671 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:54,673 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 05:15:54,673 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 05:15:54,674 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,674 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,677 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:54,677 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:54,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:54,677 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:54,677 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:54,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:54,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:54,678 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,678 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,678 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,678 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:15:54,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 05:15:54,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,679 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 05:15:54,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,680 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 05:15:54,680 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:54,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 05:15:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,681 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 05:15:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 05:15:54,681 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,681 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 05:15:54,681 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:54,681 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 05:15:54,681 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,681 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 05:15:54,681 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:54,688 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 05:15:54,688 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 05:15:54,689 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 05:15:54,688 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 05:15:54,689 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 05:15:54,689 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 05:15:54,689 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 05:15:54,689 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 05:15:54,689 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 05:15:54,691 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,691 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:54,692 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,692 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,692 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,692 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:54,692 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:54,692 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,692 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:54,692 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,692 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:54,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:54,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 05:15:54,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@606e1243[Count = 1] remaining members to acquire global barrier 2023-07-12 05:15:54,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:54,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:54,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:54,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:54,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:54,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 05:15:54,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@606e1243[Count = 0] remaining members to acquire global barrier 2023-07-12 05:15:54,701 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 05:15:54,701 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,702 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,702 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,702 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,703 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:15:54,703 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:54,702 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,703 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:15:54,703 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:54,703 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:54,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,703 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:15:54,703 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 05:15:54,703 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:15:54,703 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,704 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:15:54,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 05:15:54,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:15:54,704 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:54,704 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. started... 2023-07-12 05:15:54,704 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:15:54,704 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 089d852c23ce9d42f4c777a6e1b9f112: 2023-07-12 05:15:54,705 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,705 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:54,705 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:54,705 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:54,705 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 05:15:54,705 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:15:54,705 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:54,705 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 05:15:54,708 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:15:54,708 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. started... 2023-07-12 05:15:54,709 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e2bbfbcdf82fb9349c3c2ce1e7d40b80: 2023-07-12 05:15:54,709 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,709 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:54,709 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:15:54,728 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. completed. 2023-07-12 05:15:54,728 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:54,728 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:54,728 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:54,728 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,728 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 05:15:54,728 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:15:54,729 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. completed. 2023-07-12 05:15:54,729 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:15:54,729 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:54,729 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:54,729 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,729 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 05:15:54,729 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:15:54,738 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 05:15:54,739 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:54,739 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 05:15:54,738 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:54,740 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,741 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 05:15:54,741 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:54,741 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 05:15:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,38155,1689138862340': 2023-07-12 05:15:54,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 05:15:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:54,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,40199,1689138862404': 2023-07-12 05:15:54,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 05:15:54,749 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 05:15:54,749 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:15:54,749 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:15:54,749 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,750 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:15:54,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:54,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:54,757 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,758 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:54,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,758 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:54,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:54,758 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:54,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:54,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,759 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:54,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,762 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:54,762 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,762 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,765 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,765 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:54,765 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,765 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:54,766 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:54,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:54,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:54,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,766 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:54,766 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:54,766 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:54,766 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:54,766 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:54,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 05:15:54,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:54,766 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:54,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:54,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:15:54,766 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,768 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,768 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,768 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:54,768 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,768 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,768 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:54,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:54,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 05:15:54,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:54,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:54,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:54,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:54,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,876 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 05:15:54,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,877 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689138954600Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689138954779 (+179 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689138954779Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689138954779Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689138954793 (+14 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689138954827 (+34 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689138954876 (+49 ms) 2023-07-12 05:15:54,882 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 05:15:54,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 280 msec 2023-07-12 05:15:54,904 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:54,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 05:15:54,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:15:54,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38155] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:15:54,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40199] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:15:54,912 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 05:15:54,913 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:54,913 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:15:54,925 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:15:54,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138954925 (current time:1689138954925). 2023-07-12 05:15:54,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:15:54,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x79e9e72a to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:54,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@588d8570, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:54,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:54,936 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:54,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79e9e72a to 127.0.0.1:53723 2023-07-12 05:15:54,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:54,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x0ee3bf97 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:15:54,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3805d9d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:15:54,947 DEBUG [hconnection-0xc177da3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:54,950 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:54,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:15:54,956 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:15:54,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ee3bf97 to 127.0.0.1:53723 2023-07-12 05:15:54,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:15:54,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 05:15:54,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:15:54,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:15:54,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:15:54,962 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:15:54,963 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689139554963 2023-07-12 05:15:54,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 05:15:54,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 05:15:54,965 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:15:54,966 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:15:54,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 05:15:54,972 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 05:15:54,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-07-12 05:15:54,976 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 05:15:54,978 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689139554978 2023-07-12 05:15:54,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,995 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 05:15:54,995 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:54,997 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 05:15:54,997 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 05:15:54,997 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,997 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,998 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,998 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:54,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:54,998 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:54,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:54,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:54,998 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:54,998 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:54,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,999 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:54,999 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:15:54,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 05:15:54,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 05:15:54,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 05:15:54,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:54,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 05:15:55,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,000 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 05:15:55,000 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:55,000 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:55,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:55,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:55,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,002 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 05:15:55,002 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 05:15:55,002 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 05:15:55,002 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:55,002 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 05:15:55,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 05:15:55,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,003 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 05:15:55,004 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 05:15:55,004 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 05:15:55,004 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 05:15:55,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,004 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 05:15:55,004 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:15:55,008 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 05:15:55,008 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 05:15:55,008 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 05:15:55,009 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,009 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,009 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:55,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:55,010 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,010 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:55,010 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,010 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:55,011 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,011 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:55,012 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:55,012 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:15:55,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:55,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 05:15:55,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3466a0ca[Count = 1] remaining members to acquire global barrier 2023-07-12 05:15:55,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:55,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 05:15:55,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3466a0ca[Count = 0] remaining members to acquire global barrier 2023-07-12 05:15:55,016 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 05:15:55,016 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,017 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,017 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,017 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:15:55,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,017 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,017 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,017 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:15:55,018 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 05:15:55,018 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:15:55,018 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:55,018 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:55,018 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:55,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,018 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,018 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:15:55,018 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. started... 2023-07-12 05:15:55,018 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 089d852c23ce9d42f4c777a6e1b9f112 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-12 05:15:55,020 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 05:15:55,020 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:15:55,020 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:15:55,020 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:15:55,021 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. started... 2023-07-12 05:15:55,021 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e2bbfbcdf82fb9349c3c2ce1e7d40b80 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-12 05:15:55,022 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 05:15:55,022 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:55,022 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 05:15:55,066 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:55,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 05:15:55,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:15:55,067 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:15:55,124 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712fa0e8d90443849439ac03e81cbb81265 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712fa0e8d90443849439ac03e81cbb81265 2023-07-12 05:15:55,125 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712f5c35264c2024c0d9e9c60c1f20a3d7a to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712f5c35264c2024c0d9e9c60c1f20a3d7a 2023-07-12 05:15:55,142 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/.tmp/cf/757586afc5044abca48ed768fd4ed4e2 2023-07-12 05:15:55,146 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/.tmp/cf/669f4b4d88aa456e95a03871d7f44baa 2023-07-12 05:15:55,149 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/.tmp/cf/757586afc5044abca48ed768fd4ed4e2 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/cf/757586afc5044abca48ed768fd4ed4e2 2023-07-12 05:15:55,152 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/.tmp/cf/669f4b4d88aa456e95a03871d7f44baa as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/cf/669f4b4d88aa456e95a03871d7f44baa 2023-07-12 05:15:55,158 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/cf/757586afc5044abca48ed768fd4ed4e2, entries=5, sequenceid=6, filesize=5.8 K 2023-07-12 05:15:55,160 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/cf/669f4b4d88aa456e95a03871d7f44baa, entries=45, sequenceid=6, filesize=12.7 K 2023-07-12 05:15:55,160 INFO [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 089d852c23ce9d42f4c777a6e1b9f112 in 142ms, sequenceid=6, compaction requested=false 2023-07-12 05:15:55,163 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 089d852c23ce9d42f4c777a6e1b9f112: 2023-07-12 05:15:55,163 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,163 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:55,163 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/cf/757586afc5044abca48ed768fd4ed4e2] hfiles 2023-07-12 05:15:55,163 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/cf/757586afc5044abca48ed768fd4ed4e2 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,167 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for e2bbfbcdf82fb9349c3c2ce1e7d40b80 in 140ms, sequenceid=6, compaction requested=false 2023-07-12 05:15:55,167 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e2bbfbcdf82fb9349c3c2ce1e7d40b80: 2023-07-12 05:15:55,167 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,169 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:15:55,169 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/cf/669f4b4d88aa456e95a03871d7f44baa] hfiles 2023-07-12 05:15:55,169 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/cf/669f4b4d88aa456e95a03871d7f44baa for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,192 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. completed. 2023-07-12 05:15:55,192 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:15:55,192 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:55,192 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:55,192 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,192 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 05:15:55,192 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:15:55,193 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,193 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 05:15:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:55,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:55,193 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:55,194 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 05:15:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:55,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:55,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,40199,1689138862404': 2023-07-12 05:15:55,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 05:15:55,267 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:55,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 05:15:55,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:15:55,269 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 05:15:55,569 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:55,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 05:15:55,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:15:55,570 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 05:15:55,581 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. completed. 2023-07-12 05:15:55,581 DEBUG [rs(jenkins-hbase20.apache.org,38155,1689138862340)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:15:55,581 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:15:55,581 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:15:55,581 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,581 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 05:15:55,581 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:15:55,691 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 05:15:55,691 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,691 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:55,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:55,691 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 05:15:55,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:55,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:55,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,38155,1689138862340': 2023-07-12 05:15:55,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 05:15:55,697 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 05:15:55,697 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:15:55,697 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:15:55,697 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,697 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:15:55,731 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,732 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,731 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,731 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,732 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:55,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,732 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:55,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,732 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,732 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:15:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:15:55,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:55,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:55,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:55,732 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:15:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,733 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:15:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,734 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,734 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:15:55,735 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,784 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:55,784 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:55,784 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:55,784 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:55,784 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:15:55,784 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:55,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:55,784 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:15:55,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:55,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:55,786 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 05:15:55,784 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,786 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:15:55,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:15:55,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,786 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:15:55,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:55,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:55,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:55,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:15:55,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:55,787 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,787 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,787 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:15:55,787 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,787 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:15:55,787 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:15:55,787 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:15:55,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:15:55,787 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712f5c35264c2024c0d9e9c60c1f20a3d7a, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712fa0e8d90443849439ac03e81cbb81265] mob files 2023-07-12 05:15:55,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712f5c35264c2024c0d9e9c60c1f20a3d7a 2023-07-12 05:15:55,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712fa0e8d90443849439ac03e81cbb81265 2023-07-12 05:15:55,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 05:15:55,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,894 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:55,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689138954963Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689138955803 (+840 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689138955803Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689138955803Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689138955810 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689138955827 (+17 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689138955893 (+66 ms) 2023-07-12 05:15:55,898 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 05:15:55,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 934 msec 2023-07-12 05:15:56,071 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:15:56,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 05:15:56,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:15:56,072 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138956072 2023-07-12 05:15:56,073 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:43005, tgtDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138956072, rawTgtDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138956072, srcFsUri=hdfs://localhost.localdomain:43005, srcDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:15:56,114 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:15:56,114 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_725789869_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138956072, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138956072/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:56,115 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b, snapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 05:15:56,128 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138956072/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:15:56,216 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,216 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,217 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,217 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,218 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,218 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,219 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,303 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/hadoop-5231660168878741006.jar 2023-07-12 05:15:56,304 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,304 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,305 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,305 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,306 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,307 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 05:15:56,307 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 05:15:56,308 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 05:15:56,309 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 05:15:56,310 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 05:15:56,311 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 05:15:56,311 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 05:15:56,312 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 05:15:56,312 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 05:15:56,313 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 05:15:56,314 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 05:15:56,314 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:56,314 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:56,315 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:56,315 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:56,315 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:15:56,316 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:56,316 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:15:57,345 WARN [Listener at jenkins-hbase20.apache.org/34425] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 05:15:57,348 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 05:15:57,582 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:15:57,582 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:15:57,586 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0005_000001 (auth:SIMPLE) 2023-07-12 05:15:57,816 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0006_000001 (auth:SIMPLE) 2023-07-12 05:15:58,773 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 05:16:03,454 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0006_000001 (auth:SIMPLE) 2023-07-12 05:16:06,795 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 05:16:06,796 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 05:16:06,802 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:16:06,802 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 05:16:06,803 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 05:16:06,803 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:16:06,803 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 05:16:06,804 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 05:16:06,804 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138956072/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138956072/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:16:06,804 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138956072/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 05:16:06,804 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138956072/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 05:16:06,810 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 05:16:06,810 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testEmptyExportFileSystemState 2023-07-12 05:16:06,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 05:16:06,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 05:16:06,814 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138966814"}]},"ts":"1689138966814"} 2023-07-12 05:16:06,815 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 05:16:06,816 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 05:16:06,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=089d852c23ce9d42f4c777a6e1b9f112, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2bbfbcdf82fb9349c3c2ce1e7d40b80, UNASSIGN}] 2023-07-12 05:16:06,819 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=089d852c23ce9d42f4c777a6e1b9f112, UNASSIGN 2023-07-12 05:16:06,819 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2bbfbcdf82fb9349c3c2ce1e7d40b80, UNASSIGN 2023-07-12 05:16:06,819 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=089d852c23ce9d42f4c777a6e1b9f112, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:06,819 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e2bbfbcdf82fb9349c3c2ce1e7d40b80, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:06,819 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689138966819"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138966819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138966819"}]},"ts":"1689138966819"} 2023-07-12 05:16:06,819 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689138966819"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138966819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138966819"}]},"ts":"1689138966819"} 2023-07-12 05:16:06,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure e2bbfbcdf82fb9349c3c2ce1e7d40b80, server=jenkins-hbase20.apache.org,40199,1689138862404}] 2023-07-12 05:16:06,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 089d852c23ce9d42f4c777a6e1b9f112, server=jenkins-hbase20.apache.org,38155,1689138862340}] 2023-07-12 05:16:06,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 05:16:06,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:16:06,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 089d852c23ce9d42f4c777a6e1b9f112, disabling compactions & flushes 2023-07-12 05:16:06,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:16:06,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:16:06,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:16:06,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. after waiting 0 ms 2023-07-12 05:16:06,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:16:06,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e2bbfbcdf82fb9349c3c2ce1e7d40b80, disabling compactions & flushes 2023-07-12 05:16:06,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:16:06,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:16:06,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. after waiting 0 ms 2023-07-12 05:16:06,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:16:06,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:16:06,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:16:07,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:16:07,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:16:07,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112. 2023-07-12 05:16:07,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80. 2023-07-12 05:16:07,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 089d852c23ce9d42f4c777a6e1b9f112: 2023-07-12 05:16:07,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e2bbfbcdf82fb9349c3c2ce1e7d40b80: 2023-07-12 05:16:07,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:16:07,004 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=089d852c23ce9d42f4c777a6e1b9f112, regionState=CLOSED 2023-07-12 05:16:07,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:16:07,004 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689138967004"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138967004"}]},"ts":"1689138967004"} 2023-07-12 05:16:07,005 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=e2bbfbcdf82fb9349c3c2ce1e7d40b80, regionState=CLOSED 2023-07-12 05:16:07,005 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689138967005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138967005"}]},"ts":"1689138967005"} 2023-07-12 05:16:07,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-12 05:16:07,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 089d852c23ce9d42f4c777a6e1b9f112, server=jenkins-hbase20.apache.org,38155,1689138862340 in 186 msec 2023-07-12 05:16:07,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-12 05:16:07,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure e2bbfbcdf82fb9349c3c2ce1e7d40b80, server=jenkins-hbase20.apache.org,40199,1689138862404 in 187 msec 2023-07-12 05:16:07,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e2bbfbcdf82fb9349c3c2ce1e7d40b80, UNASSIGN in 195 msec 2023-07-12 05:16:07,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-12 05:16:07,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=089d852c23ce9d42f4c777a6e1b9f112, UNASSIGN in 195 msec 2023-07-12 05:16:07,014 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138967014"}]},"ts":"1689138967014"} 2023-07-12 05:16:07,018 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 05:16:07,019 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 05:16:07,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 210 msec 2023-07-12 05:16:07,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 05:16:07,116 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 05:16:07,117 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,120 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,121 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,124 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,126 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:16:07,126 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:16:07,126 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,126 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,126 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,126 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,126 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 05:16:07,126 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 05:16:07,127 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 05:16:07,127 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 05:16:07,127 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,128 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:07,128 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,128 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:07,128 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,128 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:07,128 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,128 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:07,128 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/recovered.edits] 2023-07-12 05:16:07,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 05:16:07,129 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/recovered.edits] 2023-07-12 05:16:07,132 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/cf/669f4b4d88aa456e95a03871d7f44baa to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/cf/669f4b4d88aa456e95a03871d7f44baa 2023-07-12 05:16:07,132 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/cf/757586afc5044abca48ed768fd4ed4e2 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/cf/757586afc5044abca48ed768fd4ed4e2 2023-07-12 05:16:07,135 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80/recovered.edits/9.seqid 2023-07-12 05:16:07,135 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112/recovered.edits/9.seqid 2023-07-12 05:16:07,135 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/e2bbfbcdf82fb9349c3c2ce1e7d40b80 2023-07-12 05:16:07,136 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testEmptyExportFileSystemState/089d852c23ce9d42f4c777a6e1b9f112 2023-07-12 05:16:07,136 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 05:16:07,136 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 05:16:07,137 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-12 05:16:07,141 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712f5c35264c2024c0d9e9c60c1f20a3d7a to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712f5c35264c2024c0d9e9c60c1f20a3d7a 2023-07-12 05:16:07,142 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712fa0e8d90443849439ac03e81cbb81265 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712fa0e8d90443849439ac03e81cbb81265 2023-07-12 05:16:07,143 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 05:16:07,145 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,147 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 05:16:07,150 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 05:16:07,158 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,158 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 05:16:07,159 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138967159"}]},"ts":"9223372036854775807"} 2023-07-12 05:16:07,159 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138967159"}]},"ts":"9223372036854775807"} 2023-07-12 05:16:07,161 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 05:16:07,161 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 089d852c23ce9d42f4c777a6e1b9f112, NAME => 'testtb-testEmptyExportFileSystemState,,1689138953906.089d852c23ce9d42f4c777a6e1b9f112.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e2bbfbcdf82fb9349c3c2ce1e7d40b80, NAME => 'testtb-testEmptyExportFileSystemState,1,1689138953906.e2bbfbcdf82fb9349c3c2ce1e7d40b80.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 05:16:07,161 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 05:16:07,162 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689138967161"}]},"ts":"9223372036854775807"} 2023-07-12 05:16:07,163 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 05:16:07,174 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 05:16:07,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 57 msec 2023-07-12 05:16:07,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 05:16:07,230 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 05:16:07,237 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 05:16:07,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 05:16:07,241 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 05:16:07,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 05:16:07,276 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 757) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:60244 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4903 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (36667302) connection to jenkins-hbase20.apache.org/148.251.75.209:44739 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1113851963_1 at /127.0.0.1:60218 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:34726 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:52418 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36667302) connection to jenkins-hbase20.apache.org/148.251.75.209:36425 from appattempt_1689138869833_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36667302) connection to jenkins-hbase20.apache.org/148.251.75.209:40649 from appattempt_1689138869833_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=449 (was 358) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=1076 (was 1094) 2023-07-12 05:16:07,276 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 05:16:07,296 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=449, ProcessCount=171, AvailableMemoryMB=1075 2023-07-12 05:16:07,296 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 05:16:07,298 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 05:16:07,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:07,303 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 05:16:07,303 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 05:16:07,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 05:16:07,307 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 05:16:07,310 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:07,310 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:07,310 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226 empty. 2023-07-12 05:16:07,310 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13 empty. 2023-07-12 05:16:07,311 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:07,312 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:07,312 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 05:16:07,332 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 05:16:07,334 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3821369e374ee4283eb19f2e31260e13, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:16:07,339 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => c27d55e258d22974e2bca5fc7df84226, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp 2023-07-12 05:16:07,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:16:07,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing c27d55e258d22974e2bca5fc7df84226, disabling compactions & flushes 2023-07-12 05:16:07,383 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:07,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:07,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. after waiting 0 ms 2023-07-12 05:16:07,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:07,383 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:07,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for c27d55e258d22974e2bca5fc7df84226: 2023-07-12 05:16:07,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:16:07,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 3821369e374ee4283eb19f2e31260e13, disabling compactions & flushes 2023-07-12 05:16:07,384 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:07,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:07,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. after waiting 0 ms 2023-07-12 05:16:07,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:07,384 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:07,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 3821369e374ee4283eb19f2e31260e13: 2023-07-12 05:16:07,387 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 05:16:07,388 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689138967387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138967387"}]},"ts":"1689138967387"} 2023-07-12 05:16:07,388 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689138967387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138967387"}]},"ts":"1689138967387"} 2023-07-12 05:16:07,390 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 05:16:07,391 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 05:16:07,391 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138967391"}]},"ts":"1689138967391"} 2023-07-12 05:16:07,392 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 05:16:07,394 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-07-12 05:16:07,395 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 05:16:07,395 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 05:16:07,395 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 05:16:07,395 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 05:16:07,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3821369e374ee4283eb19f2e31260e13, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c27d55e258d22974e2bca5fc7df84226, ASSIGN}] 2023-07-12 05:16:07,398 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c27d55e258d22974e2bca5fc7df84226, ASSIGN 2023-07-12 05:16:07,398 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3821369e374ee4283eb19f2e31260e13, ASSIGN 2023-07-12 05:16:07,401 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c27d55e258d22974e2bca5fc7df84226, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,40199,1689138862404; forceNewPlan=false, retain=false 2023-07-12 05:16:07,401 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3821369e374ee4283eb19f2e31260e13, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37993,1689138862265; forceNewPlan=false, retain=false 2023-07-12 05:16:07,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 05:16:07,551 INFO [jenkins-hbase20:36929] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 05:16:07,555 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c27d55e258d22974e2bca5fc7df84226, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:07,555 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3821369e374ee4283eb19f2e31260e13, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:07,555 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689138967555"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138967555"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138967555"}]},"ts":"1689138967555"} 2023-07-12 05:16:07,555 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689138967555"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138967555"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138967555"}]},"ts":"1689138967555"} 2023-07-12 05:16:07,557 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure c27d55e258d22974e2bca5fc7df84226, server=jenkins-hbase20.apache.org,40199,1689138862404}] 2023-07-12 05:16:07,558 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 3821369e374ee4283eb19f2e31260e13, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:16:07,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 05:16:07,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:07,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c27d55e258d22974e2bca5fc7df84226, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 05:16:07,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. service=AccessControlService 2023-07-12 05:16:07,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:16:07,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:07,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:16:07,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:07,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:07,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:07,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3821369e374ee4283eb19f2e31260e13, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 05:16:07,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. service=AccessControlService 2023-07-12 05:16:07,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 05:16:07,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:07,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 05:16:07,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:07,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:07,720 INFO [StoreOpener-c27d55e258d22974e2bca5fc7df84226-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:07,721 INFO [StoreOpener-3821369e374ee4283eb19f2e31260e13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:07,722 DEBUG [StoreOpener-c27d55e258d22974e2bca5fc7df84226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/cf 2023-07-12 05:16:07,722 DEBUG [StoreOpener-3821369e374ee4283eb19f2e31260e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/cf 2023-07-12 05:16:07,722 DEBUG [StoreOpener-3821369e374ee4283eb19f2e31260e13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/cf 2023-07-12 05:16:07,722 DEBUG [StoreOpener-c27d55e258d22974e2bca5fc7df84226-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/cf 2023-07-12 05:16:07,723 INFO [StoreOpener-3821369e374ee4283eb19f2e31260e13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3821369e374ee4283eb19f2e31260e13 columnFamilyName cf 2023-07-12 05:16:07,723 INFO [StoreOpener-c27d55e258d22974e2bca5fc7df84226-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c27d55e258d22974e2bca5fc7df84226 columnFamilyName cf 2023-07-12 05:16:07,724 INFO [StoreOpener-3821369e374ee4283eb19f2e31260e13-1] regionserver.HStore(310): Store=3821369e374ee4283eb19f2e31260e13/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:16:07,724 INFO [StoreOpener-c27d55e258d22974e2bca5fc7df84226-1] regionserver.HStore(310): Store=c27d55e258d22974e2bca5fc7df84226/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 05:16:07,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:07,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:07,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:07,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:07,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:07,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:07,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:16:07,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3821369e374ee4283eb19f2e31260e13; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74145214, jitterRate=0.10484978556632996}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:16:07,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3821369e374ee4283eb19f2e31260e13: 2023-07-12 05:16:07,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 05:16:07,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13., pid=109, masterSystemTime=1689138967710 2023-07-12 05:16:07,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c27d55e258d22974e2bca5fc7df84226; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67992292, jitterRate=0.013164103031158447}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 05:16:07,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c27d55e258d22974e2bca5fc7df84226: 2023-07-12 05:16:07,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226., pid=108, masterSystemTime=1689138967709 2023-07-12 05:16:07,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:07,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:07,733 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3821369e374ee4283eb19f2e31260e13, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:07,734 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689138967733"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138967733"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138967733"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138967733"}]},"ts":"1689138967733"} 2023-07-12 05:16:07,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:07,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:07,735 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c27d55e258d22974e2bca5fc7df84226, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:07,735 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689138967735"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689138967735"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689138967735"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689138967735"}]},"ts":"1689138967735"} 2023-07-12 05:16:07,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-12 05:16:07,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 3821369e374ee4283eb19f2e31260e13, server=jenkins-hbase20.apache.org,37993,1689138862265 in 178 msec 2023-07-12 05:16:07,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-12 05:16:07,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure c27d55e258d22974e2bca5fc7df84226, server=jenkins-hbase20.apache.org,40199,1689138862404 in 182 msec 2023-07-12 05:16:07,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3821369e374ee4283eb19f2e31260e13, ASSIGN in 345 msec 2023-07-12 05:16:07,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-12 05:16:07,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c27d55e258d22974e2bca5fc7df84226, ASSIGN in 346 msec 2023-07-12 05:16:07,743 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 05:16:07,743 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138967743"}]},"ts":"1689138967743"} 2023-07-12 05:16:07,744 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 05:16:07,747 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 05:16:07,748 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 05:16:07,750 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 05:16:07,755 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:07,755 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:07,755 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:07,756 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:07,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 05:16:07,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 05:16:07,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 05:16:07,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 05:16:07,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 458 msec 2023-07-12 05:16:07,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 05:16:07,908 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 05:16:07,912 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:07,912 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:07,913 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:16:07,925 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 05:16:07,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138967926 (current time:1689138967926). 2023-07-12 05:16:07,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:16:07,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x0f9607cf to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:16:07,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c3b1e04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:16:07,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:16:07,941 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:16:07,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f9607cf to 127.0.0.1:53723 2023-07-12 05:16:07,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:07,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x03a65ae9 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:16:07,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c318d2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:16:07,953 DEBUG [hconnection-0x581e7f91-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:16:07,958 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:16:07,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:16:07,973 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:16:07,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03a65ae9 to 127.0.0.1:53723 2023-07-12 05:16:07,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:07,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 05:16:07,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:16:07,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 05:16:07,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 05:16:07,979 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 05:16:07,980 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689139567980 2023-07-12 05:16:07,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 05:16:07,980 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:07,982 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:16:07,982 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:16:07,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 05:16:07,985 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 05:16:07,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-12 05:16:07,991 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 05:16:07,995 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689139567995 2023-07-12 05:16:08,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,011 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 05:16:08,011 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:16:08,012 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 05:16:08,012 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 05:16:08,013 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,013 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,014 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,014 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,014 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,014 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,015 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,015 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,017 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,017 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:16:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 05:16:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 05:16:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 05:16:08,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 05:16:08,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,017 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 05:16:08,018 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:16:08,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,020 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 05:16:08,020 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 05:16:08,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,020 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 05:16:08,020 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 05:16:08,020 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:16:08,022 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 05:16:08,022 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 05:16:08,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 05:16:08,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,022 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 05:16:08,022 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 05:16:08,024 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,024 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:16:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:16:08,024 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,024 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,024 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:16:08,024 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:16:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:16:08,025 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,025 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:16:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:16:08,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 05:16:08,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d7cda88[Count = 1] remaining members to acquire global barrier 2023-07-12 05:16:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:16:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:16:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:16:08,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:16:08,026 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 05:16:08,026 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:16:08,027 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 05:16:08,027 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 05:16:08,028 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 05:16:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,029 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,029 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:16:08,029 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:16:08,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 05:16:08,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d7cda88[Count = 0] remaining members to acquire global barrier 2023-07-12 05:16:08,029 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 05:16:08,029 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,030 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,030 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,030 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,030 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,030 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 05:16:08,030 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 05:16:08,030 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 05:16:08,030 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:16:08,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,031 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 05:16:08,031 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,031 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:16:08,031 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 05:16:08,031 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:16:08,031 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 05:16:08,033 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:16:08,034 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:08,034 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:16:08,034 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:16:08,034 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. started... 2023-07-12 05:16:08,034 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:08,034 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:16:08,034 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. started... 2023-07-12 05:16:08,036 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c27d55e258d22974e2bca5fc7df84226: 2023-07-12 05:16:08,036 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3821369e374ee4283eb19f2e31260e13: 2023-07-12 05:16:08,036 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,036 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,036 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:16:08,036 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:16:08,036 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:16:08,036 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 05:16:08,044 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. completed. 2023-07-12 05:16:08,044 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:08,044 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:16:08,044 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:16:08,044 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,044 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 05:16:08,045 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:16:08,047 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. completed. 2023-07-12 05:16:08,047 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:08,047 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:16:08,047 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:16:08,047 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,047 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 05:16:08,047 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:16:08,057 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,057 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 05:16:08,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:16:08,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:16:08,057 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:16:08,057 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 05:16:08,059 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,059 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 05:16:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:16:08,059 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:16:08,059 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 05:16:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:16:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:16:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,37993,1689138862265': 2023-07-12 05:16:08,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 05:16:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:16:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:16:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:16:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:16:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:16:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,40199,1689138862404': 2023-07-12 05:16:08,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 05:16:08,067 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 05:16:08,068 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:16:08,068 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:16:08,068 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,068 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:16:08,073 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,073 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,073 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,073 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,073 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:16:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:16:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,074 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,074 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:16:08,074 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,074 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,075 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:16:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,076 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:16:08,077 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,077 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,082 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,082 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,082 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,082 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,082 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,082 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,082 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,082 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:16:08,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,082 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,082 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,084 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,084 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,083 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:16:08,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,084 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,084 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:16:08,084 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,084 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,084 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,085 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 05:16:08,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:16:08,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,085 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:16:08,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 05:16:08,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,137 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 05:16:08,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,138 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689138967980Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689138968092 (+112 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689138968092Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689138968092Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689138968096 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689138968106 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689138968137 (+31 ms) 2023-07-12 05:16:08,140 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 05:16:08,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 158 msec 2023-07-12 05:16:08,285 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:16:08,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 05:16:08,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:16:08,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37993] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:16:08,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40199] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 05:16:08,292 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,292 DEBUG [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:08,292 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 05:16:08,304 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 05:16:08,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689138968304 (current time:1689138968304). 2023-07-12 05:16:08,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 05:16:08,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x0449ac90 to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:16:08,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f80b97f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:16:08,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:16:08,320 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:16:08,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0449ac90 to 127.0.0.1:53723 2023-07-12 05:16:08,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:08,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(139): Connect 0x1d6839aa to 127.0.0.1:53723 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 05:16:08,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@540c3bbb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 05:16:08,336 DEBUG [hconnection-0x7e6d3b04-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:16:08,337 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:16:08,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 05:16:08,348 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 05:16:08,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d6839aa to 127.0.0.1:53723 2023-07-12 05:16:08,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:08,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 05:16:08,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 05:16:08,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 05:16:08,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 05:16:08,354 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 05:16:08,355 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689139568355 2023-07-12 05:16:08,355 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 05:16:08,358 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 05:16:08,358 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 05:16:08,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 05:16:08,360 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 05:16:08,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-12 05:16:08,363 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 05:16:08,363 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689139568363 2023-07-12 05:16:08,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,372 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 05:16:08,372 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:16:08,373 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 05:16:08,373 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 05:16:08,374 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,374 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,375 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,375 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,375 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,375 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,375 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,375 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,376 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,376 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,376 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 05:16:08,376 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,376 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 05:16:08,378 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 05:16:08,378 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 05:16:08,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,378 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 05:16:08,378 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:16:08,378 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 05:16:08,379 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 05:16:08,379 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 05:16:08,380 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 05:16:08,380 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 05:16:08,380 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38155,1689138862340' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 05:16:08,380 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 05:16:08,380 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 05:16:08,388 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,388 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:16:08,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:16:08,392 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,392 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:16:08,392 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,392 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,392 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:16:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:16:08,392 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,392 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,392 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:16:08,392 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 05:16:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:16:08,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,40199,1689138862404' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 05:16:08,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@550c7b7f[Count = 1] remaining members to acquire global barrier 2023-07-12 05:16:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:16:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:16:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:16:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:16:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:16:08,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37993,1689138862265' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 05:16:08,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@550c7b7f[Count = 0] remaining members to acquire global barrier 2023-07-12 05:16:08,395 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 05:16:08,395 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,398 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,398 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,398 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,399 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 05:16:08,399 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 05:16:08,399 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,399 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 05:16:08,399 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:16:08,399 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:16:08,399 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 05:16:08,399 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:08,399 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38155,1689138862340' in zk 2023-07-12 05:16:08,399 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. started... 2023-07-12 05:16:08,399 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 05:16:08,399 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 05:16:08,399 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,399 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 05:16:08,399 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:08,399 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3821369e374ee4283eb19f2e31260e13 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-12 05:16:08,399 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. started... 2023-07-12 05:16:08,399 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c27d55e258d22974e2bca5fc7df84226 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-12 05:16:08,400 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 05:16:08,400 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:16:08,400 DEBUG [member: 'jenkins-hbase20.apache.org,38155,1689138862340' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 05:16:08,437 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307125303bc5d4e2a4d619b4636cc488f1c2b to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307125303bc5d4e2a4d619b4636cc488f1c2b 2023-07-12 05:16:08,438 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712cd16325647e94f62b3b5fbda24bd9a31 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712cd16325647e94f62b3b5fbda24bd9a31 2023-07-12 05:16:08,458 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:16:08,459 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/.tmp/cf/b10bdf00abff473cb5caa14d5e5c0170 2023-07-12 05:16:08,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 05:16:08,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 05:16:08,460 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 05:16:08,462 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/.tmp/cf/ffbd3a2427cc4f91a2eb37a421d7b939 2023-07-12 05:16:08,468 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/.tmp/cf/ffbd3a2427cc4f91a2eb37a421d7b939 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/cf/ffbd3a2427cc4f91a2eb37a421d7b939 2023-07-12 05:16:08,479 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/.tmp/cf/b10bdf00abff473cb5caa14d5e5c0170 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/cf/b10bdf00abff473cb5caa14d5e5c0170 2023-07-12 05:16:08,483 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/cf/ffbd3a2427cc4f91a2eb37a421d7b939, entries=7, sequenceid=6, filesize=6.2 K 2023-07-12 05:16:08,483 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/cf/b10bdf00abff473cb5caa14d5e5c0170, entries=43, sequenceid=6, filesize=12.6 K 2023-07-12 05:16:08,484 INFO [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 3821369e374ee4283eb19f2e31260e13 in 85ms, sequenceid=6, compaction requested=false 2023-07-12 05:16:08,484 INFO [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for c27d55e258d22974e2bca5fc7df84226 in 85ms, sequenceid=6, compaction requested=false 2023-07-12 05:16:08,484 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 05:16:08,484 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 05:16:08,488 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3821369e374ee4283eb19f2e31260e13: 2023-07-12 05:16:08,488 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c27d55e258d22974e2bca5fc7df84226: 2023-07-12 05:16:08,488 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,488 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,488 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:16:08,488 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 05:16:08,488 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/cf/b10bdf00abff473cb5caa14d5e5c0170] hfiles 2023-07-12 05:16:08,488 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/cf/ffbd3a2427cc4f91a2eb37a421d7b939] hfiles 2023-07-12 05:16:08,488 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/cf/b10bdf00abff473cb5caa14d5e5c0170 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,488 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/cf/ffbd3a2427cc4f91a2eb37a421d7b939 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,519 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. completed. 2023-07-12 05:16:08,519 DEBUG [rs(jenkins-hbase20.apache.org,37993,1689138862265)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:08,519 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:16:08,519 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:16:08,519 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,519 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 05:16:08,519 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,37993,1689138862265' in zk 2023-07-12 05:16:08,521 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,521 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 05:16:08,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:16:08,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:16:08,521 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:16:08,521 DEBUG [member: 'jenkins-hbase20.apache.org,37993,1689138862265' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 05:16:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:16:08,526 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. completed. 2023-07-12 05:16:08,526 DEBUG [rs(jenkins-hbase20.apache.org,40199,1689138862404)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:08,527 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 05:16:08,527 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 05:16:08,527 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,527 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 05:16:08,527 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,40199,1689138862404' in zk 2023-07-12 05:16:08,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:16:08,532 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 05:16:08,532 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:16:08,532 DEBUG [member: 'jenkins-hbase20.apache.org,40199,1689138862404' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 05:16:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,532 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:16:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,37993,1689138862265': 2023-07-12 05:16:08,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37993,1689138862265' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 05:16:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:16:08,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:16:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:16:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:16:08,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:16:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,40199,1689138862404': 2023-07-12 05:16:08,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,40199,1689138862404' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 05:16:08,541 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 05:16:08,542 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 05:16:08,542 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 05:16:08,542 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,542 INFO [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 05:16:08,543 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,543 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,543 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 05:16:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 05:16:08,543 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,543 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,543 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,543 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 05:16:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,543 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,544 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 05:16:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,544 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 05:16:08,546 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,546 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,547 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,555 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,555 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,555 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 05:16:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,555 DEBUG [(jenkins-hbase20.apache.org,36929,1689138860936)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 05:16:08,555 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,555 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,555 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,555 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,557 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,556 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,555 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 05:16:08,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 05:16:08,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 05:16:08,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,557 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,558 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,558 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,558 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:08,558 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,558 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:08,558 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:08,558 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,558 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 05:16:08,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 05:16:08,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 05:16:08,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307125303bc5d4e2a4d619b4636cc488f1c2b, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712cd16325647e94f62b3b5fbda24bd9a31] mob files 2023-07-12 05:16:08,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307125303bc5d4e2a4d619b4636cc488f1c2b 2023-07-12 05:16:08,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712cd16325647e94f62b3b5fbda24bd9a31 2023-07-12 05:16:08,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 05:16:08,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,651 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689138968355Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689138968572 (+217 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689138968572Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689138968572Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689138968579 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689138968602 (+23 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689138968650 (+48 ms) 2023-07-12 05:16:08,654 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 05:16:08,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 297 msec 2023-07-12 05:16:08,660 DEBUG [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 05:16:08,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 05:16:08,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 05:16:08,662 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138968662 2023-07-12 05:16:08,662 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:43005, tgtDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138968662, rawTgtDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138968662, srcFsUri=hdfs://localhost.localdomain:43005, srcDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:16:08,685 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b 2023-07-12 05:16:08,685 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1601891691_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138968662, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138968662/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,685 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:43005, inputRoot=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b, snapshotDir=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 05:16:08,700 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138968662/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:08,724 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,724 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,725 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,725 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,726 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,726 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,726 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,784 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/hadoop-2704041364962665947.jar 2023-07-12 05:16:08,785 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,785 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,785 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,786 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,786 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,787 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 05:16:08,787 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 05:16:08,788 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 05:16:08,788 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 05:16:08,789 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 05:16:08,789 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 05:16:08,790 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 05:16:08,790 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 05:16:08,791 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 05:16:08,791 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 05:16:08,792 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 05:16:08,792 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:16:08,793 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:16:08,793 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:16:08,793 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:16:08,794 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 05:16:08,794 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:16:08,795 DEBUG [Listener at jenkins-hbase20.apache.org/34425] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 05:16:09,468 WARN [Listener at jenkins-hbase20.apache.org/34425] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 05:16:09,471 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 05:16:09,473 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-12 05:16:10,950 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:16:10,950 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 05:16:10,963 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0006_000001 (auth:SIMPLE) 2023-07-12 05:16:11,597 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0007_000001 (auth:SIMPLE) 2023-07-12 05:16:12,616 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 05:16:16,816 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0007_000001 (auth:SIMPLE) 2023-07-12 05:16:19,128 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0007_000001 (auth:SIMPLE) 2023-07-12 05:16:22,492 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689138869833_0007_000001 (auth:SIMPLE) 2023-07-12 05:16:23,764 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 05:16:23,764 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 05:16:23,787 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:23,787 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 05:16:23,787 INFO [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 05:16:23,788 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:23,788 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 05:16:23,788 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 05:16:23,788 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-976085067_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138968662/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138968662/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:23,789 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138968662/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 05:16:23,789 DEBUG [Listener at jenkins-hbase20.apache.org/34425] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/export-test/export-1689138968662/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 05:16:23,802 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:23,802 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:23,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:23,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 05:16:23,808 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138983808"}]},"ts":"1689138983808"} 2023-07-12 05:16:23,811 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 05:16:23,812 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 05:16:23,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3821369e374ee4283eb19f2e31260e13, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c27d55e258d22974e2bca5fc7df84226, UNASSIGN}] 2023-07-12 05:16:23,817 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3821369e374ee4283eb19f2e31260e13, UNASSIGN 2023-07-12 05:16:23,817 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c27d55e258d22974e2bca5fc7df84226, UNASSIGN 2023-07-12 05:16:23,819 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c27d55e258d22974e2bca5fc7df84226, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:23,819 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=3821369e374ee4283eb19f2e31260e13, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:23,820 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689138983819"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138983819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138983819"}]},"ts":"1689138983819"} 2023-07-12 05:16:23,820 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689138983819"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689138983819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689138983819"}]},"ts":"1689138983819"} 2023-07-12 05:16:23,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure c27d55e258d22974e2bca5fc7df84226, server=jenkins-hbase20.apache.org,40199,1689138862404}] 2023-07-12 05:16:23,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 3821369e374ee4283eb19f2e31260e13, server=jenkins-hbase20.apache.org,37993,1689138862265}] 2023-07-12 05:16:23,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 05:16:23,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:23,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c27d55e258d22974e2bca5fc7df84226, disabling compactions & flushes 2023-07-12 05:16:23,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:23,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:23,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. after waiting 0 ms 2023-07-12 05:16:23,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:23,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:23,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3821369e374ee4283eb19f2e31260e13, disabling compactions & flushes 2023-07-12 05:16:23,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:23,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:23,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. after waiting 0 ms 2023-07-12 05:16:23,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:24,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:16:24,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:16:24,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226. 2023-07-12 05:16:24,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c27d55e258d22974e2bca5fc7df84226: 2023-07-12 05:16:24,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:24,060 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c27d55e258d22974e2bca5fc7df84226, regionState=CLOSED 2023-07-12 05:16:24,060 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689138984060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138984060"}]},"ts":"1689138984060"} 2023-07-12 05:16:24,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-12 05:16:24,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure c27d55e258d22974e2bca5fc7df84226, server=jenkins-hbase20.apache.org,40199,1689138862404 in 237 msec 2023-07-12 05:16:24,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c27d55e258d22974e2bca5fc7df84226, UNASSIGN in 254 msec 2023-07-12 05:16:24,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:16:24,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:16:24,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13. 2023-07-12 05:16:24,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3821369e374ee4283eb19f2e31260e13: 2023-07-12 05:16:24,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:24,077 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=3821369e374ee4283eb19f2e31260e13, regionState=CLOSED 2023-07-12 05:16:24,077 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689138984077"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689138984077"}]},"ts":"1689138984077"} 2023-07-12 05:16:24,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-12 05:16:24,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 3821369e374ee4283eb19f2e31260e13, server=jenkins-hbase20.apache.org,37993,1689138862265 in 252 msec 2023-07-12 05:16:24,086 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-12 05:16:24,086 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3821369e374ee4283eb19f2e31260e13, UNASSIGN in 271 msec 2023-07-12 05:16:24,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689138984087"}]},"ts":"1689138984087"} 2023-07-12 05:16:24,090 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 05:16:24,091 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 05:16:24,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 291 msec 2023-07-12 05:16:24,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 05:16:24,109 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 05:16:24,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,118 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,119 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,121 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38155] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,122 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,123 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,123 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,123 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 05:16:24,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 05:16:24,124 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 05:16:24,124 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:24,124 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,124 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:24,124 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,124 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:24,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 05:16:24,124 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,125 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 05:16:24,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 05:16:24,138 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:24,142 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/recovered.edits] 2023-07-12 05:16:24,146 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/cf/ffbd3a2427cc4f91a2eb37a421d7b939 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/cf/ffbd3a2427cc4f91a2eb37a421d7b939 2023-07-12 05:16:24,150 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13/recovered.edits/9.seqid 2023-07-12 05:16:24,150 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3821369e374ee4283eb19f2e31260e13 2023-07-12 05:16:24,153 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:24,157 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/cf, FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/recovered.edits] 2023-07-12 05:16:24,161 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/cf/b10bdf00abff473cb5caa14d5e5c0170 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/cf/b10bdf00abff473cb5caa14d5e5c0170 2023-07-12 05:16:24,165 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/recovered.edits/9.seqid to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226/recovered.edits/9.seqid 2023-07-12 05:16:24,166 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c27d55e258d22974e2bca5fc7df84226 2023-07-12 05:16:24,166 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 05:16:24,166 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 05:16:24,167 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-12 05:16:24,172 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307125303bc5d4e2a4d619b4636cc488f1c2b to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307125303bc5d4e2a4d619b4636cc488f1c2b 2023-07-12 05:16:24,174 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712cd16325647e94f62b3b5fbda24bd9a31 to hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230712cd16325647e94f62b3b5fbda24bd9a31 2023-07-12 05:16:24,174 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 05:16:24,177 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,182 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 05:16:24,195 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 05:16:24,197 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,197 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 05:16:24,197 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138984197"}]},"ts":"9223372036854775807"} 2023-07-12 05:16:24,197 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689138984197"}]},"ts":"9223372036854775807"} 2023-07-12 05:16:24,217 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 05:16:24,217 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3821369e374ee4283eb19f2e31260e13, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689138967298.3821369e374ee4283eb19f2e31260e13.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c27d55e258d22974e2bca5fc7df84226, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689138967298.c27d55e258d22974e2bca5fc7df84226.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 05:16:24,217 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 05:16:24,218 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689138984218"}]},"ts":"9223372036854775807"} 2023-07-12 05:16:24,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 05:16:24,230 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 05:16:24,232 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 122 msec 2023-07-12 05:16:24,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 05:16:24,428 INFO [Listener at jenkins-hbase20.apache.org/34425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 05:16:24,435 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 05:16:24,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,440 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 05:16:24,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36929] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 05:16:24,488 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 762) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5544 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (36667302) connection to jenkins-hbase20.apache.org/148.251.75.209:46173 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f27a234-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-782316845_1 at /127.0.0.1:40722 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-782316845_1 at /127.0.0.1:46738 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:46762 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:40746 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-976085067_17 at /127.0.0.1:59396 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=636 (was 449) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=1041 (was 1075) 2023-07-12 05:16:24,488 WARN [Listener at jenkins-hbase20.apache.org/34425] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-12 05:16:24,488 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 05:16:24,500 INFO [Listener at jenkins-hbase20.apache.org/34425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-12 05:16:24,623 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689138869833_0007_01_000001 is : 143 2023-07-12 05:16:29,642 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 05:16:38,625 INFO [Listener at jenkins-hbase20.apache.org/34425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-12 05:16:52,767 ERROR [Thread[Thread-407,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 05:16:52,768 INFO [Listener at jenkins-hbase20.apache.org/34425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-12 05:16:52,892 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 05:16:52,927 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 05:16:52,928 ERROR [Thread[Thread-417,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 05:16:52,957 INFO [Listener at jenkins-hbase20.apache.org/34425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-07-12 05:16:53,063 ERROR [Thread[Thread-382,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 05:16:53,063 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 05:16:53,063 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 05:16:53,063 INFO [Listener at jenkins-hbase20.apache.org/34425] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 05:16:53,063 DEBUG [Listener at jenkins-hbase20.apache.org/34425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68a122c8 to 127.0.0.1:53723 2023-07-12 05:16:53,064 DEBUG [Listener at jenkins-hbase20.apache.org/34425] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:53,064 DEBUG [Listener at jenkins-hbase20.apache.org/34425] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 05:16:53,064 DEBUG [Listener at jenkins-hbase20.apache.org/34425] util.JVMClusterUtil(257): Found active master hash=1549517524, stopped=false 2023-07-12 05:16:53,064 DEBUG [Listener at jenkins-hbase20.apache.org/34425] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:16:53,064 DEBUG [Listener at jenkins-hbase20.apache.org/34425] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 05:16:53,064 INFO [Listener at jenkins-hbase20.apache.org/34425] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,36929,1689138860936 2023-07-12 05:16:53,119 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 05:16:53,119 INFO [Listener at jenkins-hbase20.apache.org/34425] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 05:16:53,119 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 05:16:53,119 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 05:16:53,120 DEBUG [Listener at jenkins-hbase20.apache.org/34425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63e81915 to 127.0.0.1:53723 2023-07-12 05:16:53,119 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 05:16:53,120 DEBUG [Listener at jenkins-hbase20.apache.org/34425] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:53,120 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 05:16:53,120 INFO [Listener at jenkins-hbase20.apache.org/34425] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,37993,1689138862265' ***** 2023-07-12 05:16:53,120 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 05:16:53,120 DEBUG [Listener at jenkins-hbase20.apache.org/34425] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:16:53,120 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 05:16:53,120 INFO [Listener at jenkins-hbase20.apache.org/34425] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 05:16:53,121 INFO [Listener at jenkins-hbase20.apache.org/34425] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38155,1689138862340' ***** 2023-07-12 05:16:53,121 DEBUG [Listener at jenkins-hbase20.apache.org/34425] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:16:53,121 INFO [RS:0;jenkins-hbase20:37993] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 05:16:53,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 05:16:53,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 05:16:53,121 INFO [RS:0;jenkins-hbase20:37993] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 05:16:53,121 INFO [Listener at jenkins-hbase20.apache.org/34425] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 05:16:53,122 INFO [RS:0;jenkins-hbase20:37993] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 05:16:53,122 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 05:16:53,122 INFO [Listener at jenkins-hbase20.apache.org/34425] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,40199,1689138862404' ***** 2023-07-12 05:16:53,122 INFO [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:53,122 DEBUG [Listener at jenkins-hbase20.apache.org/34425] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:16:53,122 DEBUG [RS:0;jenkins-hbase20:37993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53312b18 to 127.0.0.1:53723 2023-07-12 05:16:53,122 INFO [Listener at jenkins-hbase20.apache.org/34425] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 05:16:53,122 INFO [RS:1;jenkins-hbase20:38155] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 05:16:53,122 DEBUG [RS:0;jenkins-hbase20:37993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:53,122 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 05:16:53,122 INFO [RS:2;jenkins-hbase20:40199] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 05:16:53,122 INFO [RS:1;jenkins-hbase20:38155] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 05:16:53,126 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 05:16:53,126 INFO [RS:2;jenkins-hbase20:40199] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 05:16:53,125 INFO [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,37993,1689138862265; all regions closed. 2023-07-12 05:16:53,126 INFO [RS:2;jenkins-hbase20:40199] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 05:16:53,126 INFO [RS:1;jenkins-hbase20:38155] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 05:16:53,126 INFO [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:53,126 DEBUG [RS:2;jenkins-hbase20:40199] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4791e265 to 127.0.0.1:53723 2023-07-12 05:16:53,126 DEBUG [RS:2;jenkins-hbase20:40199] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:53,126 INFO [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(3305): Received CLOSE for 70d56ac09924781810caf6b6596b7de1 2023-07-12 05:16:53,127 INFO [RS:2;jenkins-hbase20:40199] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 05:16:53,127 INFO [RS:2;jenkins-hbase20:40199] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 05:16:53,127 INFO [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(3305): Received CLOSE for ab90c6aa8d038fa91b29a25a1b6725f7 2023-07-12 05:16:53,127 INFO [RS:2;jenkins-hbase20:40199] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 05:16:53,127 INFO [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:53,128 INFO [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 05:16:53,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 70d56ac09924781810caf6b6596b7de1, disabling compactions & flushes 2023-07-12 05:16:53,128 DEBUG [RS:1;jenkins-hbase20:38155] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x708a7286 to 127.0.0.1:53723 2023-07-12 05:16:53,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:16:53,128 DEBUG [RS:1;jenkins-hbase20:38155] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:53,128 INFO [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 05:16:53,129 INFO [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-12 05:16:53,129 DEBUG [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-12 05:16:53,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:16:53,130 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 05:16:53,129 DEBUG [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1478): Online Regions={70d56ac09924781810caf6b6596b7de1=hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1., ab90c6aa8d038fa91b29a25a1b6725f7=hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7.} 2023-07-12 05:16:53,130 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 05:16:53,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. after waiting 0 ms 2023-07-12 05:16:53,130 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 05:16:53,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:16:53,130 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 05:16:53,130 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 05:16:53,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 70d56ac09924781810caf6b6596b7de1 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 05:16:53,130 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-07-12 05:16:53,130 DEBUG [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1504): Waiting on 70d56ac09924781810caf6b6596b7de1, ab90c6aa8d038fa91b29a25a1b6725f7 2023-07-12 05:16:53,130 DEBUG [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-12 05:16:53,148 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 05:16:53,153 DEBUG [RS:0;jenkins-hbase20:37993] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/oldWALs 2023-07-12 05:16:53,153 INFO [RS:0;jenkins-hbase20:37993] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C37993%2C1689138862265:(num 1689138864416) 2023-07-12 05:16:53,153 DEBUG [RS:0;jenkins-hbase20:37993] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:53,153 INFO [RS:0;jenkins-hbase20:37993] regionserver.LeaseManager(133): Closed leases 2023-07-12 05:16:53,154 INFO [RS:0;jenkins-hbase20:37993] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 05:16:53,154 INFO [RS:0;jenkins-hbase20:37993] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 05:16:53,154 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 05:16:53,154 INFO [RS:0;jenkins-hbase20:37993] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 05:16:53,154 INFO [RS:0;jenkins-hbase20:37993] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 05:16:53,168 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 05:16:53,172 INFO [RS:0;jenkins-hbase20:37993] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:37993 2023-07-12 05:16:53,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1/.tmp/info/47d0dad2335a46dd86fbd1a1263ecf28 2023-07-12 05:16:53,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/.tmp/info/d87188e5c6f44f07bcea3a8e49b72a9c 2023-07-12 05:16:53,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1/.tmp/info/47d0dad2335a46dd86fbd1a1263ecf28 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1/info/47d0dad2335a46dd86fbd1a1263ecf28 2023-07-12 05:16:53,199 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 05:16:53,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1/info/47d0dad2335a46dd86fbd1a1263ecf28, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 05:16:53,204 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d87188e5c6f44f07bcea3a8e49b72a9c 2023-07-12 05:16:53,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 70d56ac09924781810caf6b6596b7de1 in 75ms, sequenceid=6, compaction requested=false 2023-07-12 05:16:53,210 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:53,210 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 05:16:53,210 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 05:16:53,210 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:53,210 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 05:16:53,212 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,37993,1689138862265 2023-07-12 05:16:53,212 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 05:16:53,212 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,37993,1689138862265] 2023-07-12 05:16:53,214 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,37993,1689138862265; numProcessing=1 2023-07-12 05:16:53,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/namespace/70d56ac09924781810caf6b6596b7de1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 05:16:53,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:16:53,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:16:53,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 70d56ac09924781810caf6b6596b7de1: 2023-07-12 05:16:53,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689138865047.70d56ac09924781810caf6b6596b7de1. 2023-07-12 05:16:53,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ab90c6aa8d038fa91b29a25a1b6725f7, disabling compactions & flushes 2023-07-12 05:16:53,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:16:53,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:16:53,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. after waiting 0 ms 2023-07-12 05:16:53,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:16:53,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing ab90c6aa8d038fa91b29a25a1b6725f7 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 05:16:53,229 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 05:16:53,230 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 05:16:53,233 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-12 05:16:53,233 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-12 05:16:53,244 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/.tmp/rep_barrier/c5b3992f6de847a5b346b039c801bece 2023-07-12 05:16:53,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7/.tmp/l/177ff28241c2478e8fbd0e4fa6c4d062 2023-07-12 05:16:53,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 177ff28241c2478e8fbd0e4fa6c4d062 2023-07-12 05:16:53,252 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5b3992f6de847a5b346b039c801bece 2023-07-12 05:16:53,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7/.tmp/l/177ff28241c2478e8fbd0e4fa6c4d062 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7/l/177ff28241c2478e8fbd0e4fa6c4d062 2023-07-12 05:16:53,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 177ff28241c2478e8fbd0e4fa6c4d062 2023-07-12 05:16:53,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7/l/177ff28241c2478e8fbd0e4fa6c4d062, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 05:16:53,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ab90c6aa8d038fa91b29a25a1b6725f7 in 48ms, sequenceid=18, compaction requested=false 2023-07-12 05:16:53,271 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/.tmp/table/cb049d40a6b44e209ca755eb8d9b4cc0 2023-07-12 05:16:53,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/acl/ab90c6aa8d038fa91b29a25a1b6725f7/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 05:16:53,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:16:53,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:16:53,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ab90c6aa8d038fa91b29a25a1b6725f7: 2023-07-12 05:16:53,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689138865841.ab90c6aa8d038fa91b29a25a1b6725f7. 2023-07-12 05:16:53,282 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb049d40a6b44e209ca755eb8d9b4cc0 2023-07-12 05:16:53,283 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/.tmp/info/d87188e5c6f44f07bcea3a8e49b72a9c as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/info/d87188e5c6f44f07bcea3a8e49b72a9c 2023-07-12 05:16:53,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d87188e5c6f44f07bcea3a8e49b72a9c 2023-07-12 05:16:53,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/info/d87188e5c6f44f07bcea3a8e49b72a9c, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 05:16:53,289 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/.tmp/rep_barrier/c5b3992f6de847a5b346b039c801bece as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/rep_barrier/c5b3992f6de847a5b346b039c801bece 2023-07-12 05:16:53,294 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5b3992f6de847a5b346b039c801bece 2023-07-12 05:16:53,294 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/rep_barrier/c5b3992f6de847a5b346b039c801bece, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 05:16:53,295 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/.tmp/table/cb049d40a6b44e209ca755eb8d9b4cc0 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/table/cb049d40a6b44e209ca755eb8d9b4cc0 2023-07-12 05:16:53,300 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb049d40a6b44e209ca755eb8d9b4cc0 2023-07-12 05:16:53,300 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/table/cb049d40a6b44e209ca755eb8d9b4cc0, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 05:16:53,301 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 171ms, sequenceid=131, compaction requested=false 2023-07-12 05:16:53,312 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 05:16:53,312 INFO [RS:0;jenkins-hbase20:37993] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,37993,1689138862265; zookeeper connection closed. 2023-07-12 05:16:53,312 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:37993-0x1007f9a0c7d0001, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 05:16:53,314 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,37993,1689138862265 already deleted, retry=false 2023-07-12 05:16:53,314 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,37993,1689138862265 expired; onlineServers=2 2023-07-12 05:16:53,314 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1e3a8de3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1e3a8de3 2023-07-12 05:16:53,318 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 05:16:53,319 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 05:16:53,319 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 05:16:53,320 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 05:16:53,320 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 05:16:53,321 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 05:16:53,330 INFO [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38155,1689138862340; all regions closed. 2023-07-12 05:16:53,330 INFO [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,40199,1689138862404; all regions closed. 2023-07-12 05:16:53,356 DEBUG [RS:1;jenkins-hbase20:38155] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/oldWALs 2023-07-12 05:16:53,356 INFO [RS:1;jenkins-hbase20:38155] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38155%2C1689138862340:(num 1689138864415) 2023-07-12 05:16:53,357 DEBUG [RS:1;jenkins-hbase20:38155] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:53,357 INFO [RS:1;jenkins-hbase20:38155] regionserver.LeaseManager(133): Closed leases 2023-07-12 05:16:53,357 INFO [RS:1;jenkins-hbase20:38155] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 05:16:53,358 INFO [RS:1;jenkins-hbase20:38155] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 05:16:53,358 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 05:16:53,358 INFO [RS:1;jenkins-hbase20:38155] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 05:16:53,358 INFO [RS:1;jenkins-hbase20:38155] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 05:16:53,359 DEBUG [RS:2;jenkins-hbase20:40199] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/oldWALs 2023-07-12 05:16:53,359 INFO [RS:2;jenkins-hbase20:40199] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C40199%2C1689138862404.meta:.meta(num 1689138864595) 2023-07-12 05:16:53,360 INFO [RS:1;jenkins-hbase20:38155] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38155 2023-07-12 05:16:53,361 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:53,361 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 05:16:53,361 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38155,1689138862340 2023-07-12 05:16:53,362 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38155,1689138862340] 2023-07-12 05:16:53,363 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38155,1689138862340; numProcessing=2 2023-07-12 05:16:53,365 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38155,1689138862340 already deleted, retry=false 2023-07-12 05:16:53,366 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38155,1689138862340 expired; onlineServers=1 2023-07-12 05:16:53,368 DEBUG [RS:2;jenkins-hbase20:40199] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/oldWALs 2023-07-12 05:16:53,368 INFO [RS:2;jenkins-hbase20:40199] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C40199%2C1689138862404:(num 1689138864416) 2023-07-12 05:16:53,368 DEBUG [RS:2;jenkins-hbase20:40199] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:53,368 INFO [RS:2;jenkins-hbase20:40199] regionserver.LeaseManager(133): Closed leases 2023-07-12 05:16:53,368 INFO [RS:2;jenkins-hbase20:40199] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 05:16:53,368 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 05:16:53,369 INFO [RS:2;jenkins-hbase20:40199] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:40199 2023-07-12 05:16:53,465 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 05:16:53,465 INFO [RS:1;jenkins-hbase20:38155] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38155,1689138862340; zookeeper connection closed. 2023-07-12 05:16:53,465 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:38155-0x1007f9a0c7d0002, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 05:16:53,465 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6d8c2697] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6d8c2697 2023-07-12 05:16:53,478 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 05:16:53,478 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,40199,1689138862404 2023-07-12 05:16:53,480 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,40199,1689138862404] 2023-07-12 05:16:53,480 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,40199,1689138862404; numProcessing=3 2023-07-12 05:16:53,481 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,40199,1689138862404 already deleted, retry=false 2023-07-12 05:16:53,481 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,40199,1689138862404 expired; onlineServers=0 2023-07-12 05:16:53,481 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,36929,1689138860936' ***** 2023-07-12 05:16:53,481 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 05:16:53,481 DEBUG [M:0;jenkins-hbase20:36929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d66c8ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-07-12 05:16:53,481 INFO [M:0;jenkins-hbase20:36929] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,36929,1689138860936 2023-07-12 05:16:53,481 INFO [M:0;jenkins-hbase20:36929] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,36929,1689138860936; all regions closed. 2023-07-12 05:16:53,481 DEBUG [M:0;jenkins-hbase20:36929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 05:16:53,481 DEBUG [M:0;jenkins-hbase20:36929] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 05:16:53,481 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 05:16:53,481 DEBUG [M:0;jenkins-hbase20:36929] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 05:16:53,481 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689138864003] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1689138864003,5,FailOnTimeoutGroup] 2023-07-12 05:16:53,481 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689138863998] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1689138863998,5,FailOnTimeoutGroup] 2023-07-12 05:16:53,481 INFO [M:0;jenkins-hbase20:36929] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 05:16:53,482 INFO [M:0;jenkins-hbase20:36929] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 05:16:53,482 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 05:16:53,482 INFO [M:0;jenkins-hbase20:36929] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-07-12 05:16:53,482 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 05:16:53,482 DEBUG [M:0;jenkins-hbase20:36929] master.HMaster(1512): Stopping service threads 2023-07-12 05:16:53,482 INFO [M:0;jenkins-hbase20:36929] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 05:16:53,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 05:16:53,482 ERROR [M:0;jenkins-hbase20:36929] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-12 05:16:53,483 INFO [M:0;jenkins-hbase20:36929] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 05:16:53,483 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 05:16:53,483 DEBUG [M:0;jenkins-hbase20:36929] zookeeper.ZKUtil(398): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 05:16:53,483 WARN [M:0;jenkins-hbase20:36929] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 05:16:53,483 INFO [M:0;jenkins-hbase20:36929] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 05:16:53,483 INFO [M:0;jenkins-hbase20:36929] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 05:16:53,484 DEBUG [M:0;jenkins-hbase20:36929] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 05:16:53,484 INFO [M:0;jenkins-hbase20:36929] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 05:16:53,484 DEBUG [M:0;jenkins-hbase20:36929] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 05:16:53,484 DEBUG [M:0;jenkins-hbase20:36929] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 05:16:53,484 DEBUG [M:0;jenkins-hbase20:36929] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 05:16:53,484 INFO [M:0;jenkins-hbase20:36929] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.11 KB heapSize=452.04 KB 2023-07-12 05:16:53,510 INFO [M:0;jenkins-hbase20:36929] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.11 KB at sequenceid=895 (bloomFilter=true), to=hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/80e05d1698ca4ee69f317fe2f0a66a68 2023-07-12 05:16:53,514 INFO [M:0;jenkins-hbase20:36929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80e05d1698ca4ee69f317fe2f0a66a68 2023-07-12 05:16:53,515 DEBUG [M:0;jenkins-hbase20:36929] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/80e05d1698ca4ee69f317fe2f0a66a68 as hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/80e05d1698ca4ee69f317fe2f0a66a68 2023-07-12 05:16:53,519 INFO [M:0;jenkins-hbase20:36929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80e05d1698ca4ee69f317fe2f0a66a68 2023-07-12 05:16:53,520 INFO [M:0;jenkins-hbase20:36929] regionserver.HStore(1080): Added hdfs://localhost.localdomain:43005/user/jenkins/test-data/a6bbd7b4-4fb1-f66a-d070-536dc159161b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/80e05d1698ca4ee69f317fe2f0a66a68, entries=119, sequenceid=895, filesize=28.7 K 2023-07-12 05:16:53,521 INFO [M:0;jenkins-hbase20:36929] regionserver.HRegion(2948): Finished flush of dataSize ~376.11 KB/385140, heapSize ~452.02 KB/462872, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 37ms, sequenceid=895, compaction requested=false 2023-07-12 05:16:53,523 INFO [M:0;jenkins-hbase20:36929] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 05:16:53,523 DEBUG [M:0;jenkins-hbase20:36929] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 05:16:53,526 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 05:16:53,527 INFO [M:0;jenkins-hbase20:36929] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 05:16:53,527 INFO [M:0;jenkins-hbase20:36929] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36929 2023-07-12 05:16:53,528 DEBUG [M:0;jenkins-hbase20:36929] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,36929,1689138860936 already deleted, retry=false 2023-07-12 05:16:53,580 INFO [RS:2;jenkins-hbase20:40199] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,40199,1689138862404; zookeeper connection closed. 2023-07-12 05:16:53,580 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 05:16:53,580 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): regionserver:40199-0x1007f9a0c7d0003, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 05:16:53,582 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@18b96866] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@18b96866 2023-07-12 05:16:53,583 INFO [Listener at jenkins-hbase20.apache.org/34425] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 05:16:53,680 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 05:16:53,680 INFO [M:0;jenkins-hbase20:36929] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,36929,1689138860936; zookeeper connection closed. 2023-07-12 05:16:53,680 DEBUG [Listener at localhost.localdomain/45981-EventThread] zookeeper.ZKWatcher(600): master:36929-0x1007f9a0c7d0000, quorum=127.0.0.1:53723, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 05:16:53,682 WARN [Listener at jenkins-hbase20.apache.org/34425] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 05:16:53,688 INFO [Listener at jenkins-hbase20.apache.org/34425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 05:16:53,795 WARN [BP-298640166-148.251.75.209-1689138856975 heartbeating to localhost.localdomain/127.0.0.1:43005] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 05:16:53,795 WARN [BP-298640166-148.251.75.209-1689138856975 heartbeating to localhost.localdomain/127.0.0.1:43005] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-298640166-148.251.75.209-1689138856975 (Datanode Uuid 4ae7fa5e-130a-4fb2-bf9a-3c0c591cda06) service to localhost.localdomain/127.0.0.1:43005 2023-07-12 05:16:53,799 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data5/current/BP-298640166-148.251.75.209-1689138856975] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 05:16:53,800 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data6/current/BP-298640166-148.251.75.209-1689138856975] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 05:16:53,802 WARN [Listener at jenkins-hbase20.apache.org/34425] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 05:16:53,805 INFO [Listener at jenkins-hbase20.apache.org/34425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 05:16:53,808 WARN [BP-298640166-148.251.75.209-1689138856975 heartbeating to localhost.localdomain/127.0.0.1:43005] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 05:16:53,808 WARN [BP-298640166-148.251.75.209-1689138856975 heartbeating to localhost.localdomain/127.0.0.1:43005] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-298640166-148.251.75.209-1689138856975 (Datanode Uuid 42905543-4e60-4b0c-9139-dbca9fbccf02) service to localhost.localdomain/127.0.0.1:43005 2023-07-12 05:16:53,809 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data4/current/BP-298640166-148.251.75.209-1689138856975] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 05:16:53,810 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data3/current/BP-298640166-148.251.75.209-1689138856975] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 05:16:53,811 WARN [Listener at jenkins-hbase20.apache.org/34425] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 05:16:53,816 INFO [Listener at jenkins-hbase20.apache.org/34425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 05:16:53,929 WARN [BP-298640166-148.251.75.209-1689138856975 heartbeating to localhost.localdomain/127.0.0.1:43005] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 05:16:53,929 WARN [BP-298640166-148.251.75.209-1689138856975 heartbeating to localhost.localdomain/127.0.0.1:43005] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-298640166-148.251.75.209-1689138856975 (Datanode Uuid 4649c173-cae0-4486-adfa-5bc0bbba6d3c) service to localhost.localdomain/127.0.0.1:43005 2023-07-12 05:16:53,930 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data1/current/BP-298640166-148.251.75.209-1689138856975] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 05:16:53,931 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f300ac99-ac3a-360d-3538-ce09778bc775/cluster_216e8dfc-4336-80a3-b37d-5c9a1d7d9297/dfs/data/data2/current/BP-298640166-148.251.75.209-1689138856975] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 05:16:53,957 INFO [Listener at jenkins-hbase20.apache.org/34425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-12 05:16:54,101 INFO [Listener at jenkins-hbase20.apache.org/34425] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 05:16:54,242 INFO [Listener at jenkins-hbase20.apache.org/34425] hbase.HBaseTestingUtility(1293): Minicluster is down