2023-07-14 10:12:18,816 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-14 10:12:19,080 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed 2023-07-14 10:12:19,080 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-14 10:12:19,129 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-14 10:12:19,474 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-14 10:12:19,475 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693, deleteOnExit=true 2023-07-14 10:12:19,475 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-14 10:12:19,476 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/test.cache.data in system properties and HBase conf 2023-07-14 10:12:19,477 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 10:12:19,477 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop.log.dir in system properties and HBase conf 2023-07-14 10:12:19,478 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 10:12:19,478 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 10:12:19,478 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 10:12:19,993 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-14 10:12:20,000 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 10:12:20,000 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 10:12:20,001 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 10:12:20,001 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 10:12:20,002 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 10:12:20,002 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 10:12:20,002 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 10:12:20,003 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 10:12:20,003 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 10:12:20,004 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/nfs.dump.dir in system properties and HBase conf 2023-07-14 10:12:20,004 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/java.io.tmpdir in system properties and HBase conf 2023-07-14 10:12:20,004 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 10:12:20,005 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 10:12:20,005 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-14 10:12:20,810 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 10:12:20,816 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 10:12:21,190 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-14 10:12:21,422 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-14 10:12:21,442 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 10:12:21,493 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 10:12:21,540 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/java.io.tmpdir/Jetty_localhost_33893_hdfs____.gqjm90/webapp 2023-07-14 10:12:21,712 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33893 2023-07-14 10:12:21,728 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 10:12:21,729 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 10:12:22,409 WARN [Listener at localhost/36399] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 10:12:22,541 WARN [Listener at localhost/36399] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 10:12:22,574 WARN [Listener at localhost/36399] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 10:12:22,583 INFO [Listener at localhost/36399] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 10:12:22,642 INFO [Listener at localhost/36399] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/java.io.tmpdir/Jetty_localhost_43197_datanode____.pfxvjd/webapp 2023-07-14 10:12:22,773 INFO [Listener at localhost/36399] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43197 2023-07-14 10:12:23,255 WARN [Listener at localhost/44057] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 10:12:23,312 WARN [Listener at localhost/44057] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 10:12:23,316 WARN [Listener at localhost/44057] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 10:12:23,318 INFO [Listener at localhost/44057] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 10:12:23,328 INFO [Listener at localhost/44057] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/java.io.tmpdir/Jetty_localhost_33889_datanode____.gpd1vk/webapp 2023-07-14 10:12:23,465 INFO [Listener at localhost/44057] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33889 2023-07-14 10:12:23,483 WARN [Listener at localhost/44859] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 10:12:23,527 WARN [Listener at localhost/44859] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 10:12:23,531 WARN [Listener at localhost/44859] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 10:12:23,532 INFO [Listener at localhost/44859] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 10:12:23,545 INFO [Listener at localhost/44859] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/java.io.tmpdir/Jetty_localhost_39933_datanode____shj5ay/webapp 2023-07-14 10:12:23,711 INFO [Listener at localhost/44859] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39933 2023-07-14 10:12:23,762 WARN [Listener at localhost/38773] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 10:12:24,008 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3812c2ebdaff60ff: Processing first storage report for DS-ede41026-45f0-41aa-a07e-6acdce792b22 from datanode 12c41ce3-9b13-4dd1-81df-9d4389cf40c9 2023-07-14 10:12:24,010 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3812c2ebdaff60ff: from storage DS-ede41026-45f0-41aa-a07e-6acdce792b22 node DatanodeRegistration(127.0.0.1:42781, datanodeUuid=12c41ce3-9b13-4dd1-81df-9d4389cf40c9, infoPort=34763, infoSecurePort=0, ipcPort=44057, storageInfo=lv=-57;cid=testClusterID;nsid=473649825;c=1689329540929), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-14 10:12:24,011 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb87ca6d1e09bedac: Processing first storage report for DS-6fe79f65-8523-4dd2-b7a3-d091e820b545 from datanode 077119fc-a067-4a38-b368-113fe2f2b71e 2023-07-14 10:12:24,011 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb87ca6d1e09bedac: from storage DS-6fe79f65-8523-4dd2-b7a3-d091e820b545 node DatanodeRegistration(127.0.0.1:45141, datanodeUuid=077119fc-a067-4a38-b368-113fe2f2b71e, infoPort=33689, infoSecurePort=0, ipcPort=38773, storageInfo=lv=-57;cid=testClusterID;nsid=473649825;c=1689329540929), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 10:12:24,011 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9ad637866dbb27bb: Processing first storage report for DS-8efe8c53-031a-4910-8b9d-7c8323f6945e from datanode d6c0e443-8725-46f9-bddd-c83776138253 2023-07-14 10:12:24,011 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9ad637866dbb27bb: from storage DS-8efe8c53-031a-4910-8b9d-7c8323f6945e node DatanodeRegistration(127.0.0.1:45849, datanodeUuid=d6c0e443-8725-46f9-bddd-c83776138253, infoPort=37159, infoSecurePort=0, ipcPort=44859, storageInfo=lv=-57;cid=testClusterID;nsid=473649825;c=1689329540929), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 10:12:24,011 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3812c2ebdaff60ff: Processing first storage report for DS-a1fe61a2-225e-4b9b-9238-29feafb25d3b from datanode 12c41ce3-9b13-4dd1-81df-9d4389cf40c9 2023-07-14 10:12:24,012 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3812c2ebdaff60ff: from storage DS-a1fe61a2-225e-4b9b-9238-29feafb25d3b node DatanodeRegistration(127.0.0.1:42781, datanodeUuid=12c41ce3-9b13-4dd1-81df-9d4389cf40c9, infoPort=34763, infoSecurePort=0, ipcPort=44057, storageInfo=lv=-57;cid=testClusterID;nsid=473649825;c=1689329540929), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 10:12:24,012 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb87ca6d1e09bedac: Processing first storage report for DS-c2363547-4cf0-4f2c-92af-dfd304d1bac1 from datanode 077119fc-a067-4a38-b368-113fe2f2b71e 2023-07-14 10:12:24,012 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb87ca6d1e09bedac: from storage DS-c2363547-4cf0-4f2c-92af-dfd304d1bac1 node DatanodeRegistration(127.0.0.1:45141, datanodeUuid=077119fc-a067-4a38-b368-113fe2f2b71e, infoPort=33689, infoSecurePort=0, ipcPort=38773, storageInfo=lv=-57;cid=testClusterID;nsid=473649825;c=1689329540929), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 10:12:24,012 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9ad637866dbb27bb: Processing first storage report for DS-637abcdb-400d-4815-8cd2-013d49a28478 from datanode d6c0e443-8725-46f9-bddd-c83776138253 2023-07-14 10:12:24,013 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9ad637866dbb27bb: from storage DS-637abcdb-400d-4815-8cd2-013d49a28478 node DatanodeRegistration(127.0.0.1:45849, datanodeUuid=d6c0e443-8725-46f9-bddd-c83776138253, infoPort=37159, infoSecurePort=0, ipcPort=44859, storageInfo=lv=-57;cid=testClusterID;nsid=473649825;c=1689329540929), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 10:12:24,345 DEBUG [Listener at localhost/38773] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed 2023-07-14 10:12:24,442 INFO [Listener at localhost/38773] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/zookeeper_0, clientPort=60034, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-14 10:12:24,464 INFO [Listener at localhost/38773] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60034 2023-07-14 10:12:24,475 INFO [Listener at localhost/38773] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 10:12:24,477 INFO [Listener at localhost/38773] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 10:12:25,179 INFO [Listener at localhost/38773] util.FSUtils(471): Created version file at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a with version=8 2023-07-14 10:12:25,180 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/hbase-staging 2023-07-14 10:12:25,597 INFO [Listener at localhost/38773] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-14 10:12:26,212 INFO [Listener at localhost/38773] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 10:12:26,249 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:26,250 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:26,250 INFO [Listener at localhost/38773] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 10:12:26,250 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:26,250 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 10:12:26,407 INFO [Listener at localhost/38773] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 10:12:26,501 DEBUG [Listener at localhost/38773] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-14 10:12:26,637 INFO [Listener at localhost/38773] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39063 2023-07-14 10:12:26,655 INFO [Listener at localhost/38773] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 10:12:26,658 INFO [Listener at localhost/38773] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 10:12:26,690 INFO [Listener at localhost/38773] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39063 connecting to ZooKeeper ensemble=127.0.0.1:60034 2023-07-14 10:12:26,787 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:390630x0, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 10:12:26,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39063-0x1016343f0830000 connected 2023-07-14 10:12:26,844 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 10:12:26,846 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 10:12:26,865 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 10:12:26,877 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39063 2023-07-14 10:12:26,880 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39063 2023-07-14 10:12:26,881 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39063 2023-07-14 10:12:26,884 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39063 2023-07-14 10:12:26,884 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39063 2023-07-14 10:12:26,891 INFO [Listener at localhost/38773] master.HMaster(444): hbase.rootdir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a, hbase.cluster.distributed=false 2023-07-14 10:12:26,986 INFO [Listener at localhost/38773] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 10:12:26,986 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:26,986 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:26,987 INFO [Listener at localhost/38773] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 10:12:26,987 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:26,987 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 10:12:26,993 INFO [Listener at localhost/38773] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 10:12:26,995 INFO [Listener at localhost/38773] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35921 2023-07-14 10:12:26,998 INFO [Listener at localhost/38773] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 10:12:27,006 DEBUG [Listener at localhost/38773] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 10:12:27,007 INFO [Listener at localhost/38773] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 10:12:27,009 INFO [Listener at localhost/38773] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 10:12:27,012 INFO [Listener at localhost/38773] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35921 connecting to ZooKeeper ensemble=127.0.0.1:60034 2023-07-14 10:12:27,018 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:359210x0, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 10:12:27,019 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): regionserver:359210x0, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 10:12:27,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35921-0x1016343f0830001 connected 2023-07-14 10:12:27,023 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 10:12:27,024 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 10:12:27,024 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35921 2023-07-14 10:12:27,024 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35921 2023-07-14 10:12:27,026 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35921 2023-07-14 10:12:27,028 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35921 2023-07-14 10:12:27,029 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35921 2023-07-14 10:12:27,044 INFO [Listener at localhost/38773] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 10:12:27,045 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:27,045 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:27,045 INFO [Listener at localhost/38773] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 10:12:27,046 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:27,046 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 10:12:27,046 INFO [Listener at localhost/38773] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 10:12:27,048 INFO [Listener at localhost/38773] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39405 2023-07-14 10:12:27,048 INFO [Listener at localhost/38773] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 10:12:27,049 DEBUG [Listener at localhost/38773] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 10:12:27,051 INFO [Listener at localhost/38773] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 10:12:27,053 INFO [Listener at localhost/38773] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 10:12:27,056 INFO [Listener at localhost/38773] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39405 connecting to ZooKeeper ensemble=127.0.0.1:60034 2023-07-14 10:12:27,063 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:394050x0, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 10:12:27,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39405-0x1016343f0830002 connected 2023-07-14 10:12:27,065 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 10:12:27,066 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 10:12:27,067 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 10:12:27,071 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39405 2023-07-14 10:12:27,072 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39405 2023-07-14 10:12:27,073 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39405 2023-07-14 10:12:27,074 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39405 2023-07-14 10:12:27,074 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39405 2023-07-14 10:12:27,089 INFO [Listener at localhost/38773] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 10:12:27,089 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:27,089 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:27,089 INFO [Listener at localhost/38773] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 10:12:27,089 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 10:12:27,089 INFO [Listener at localhost/38773] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 10:12:27,089 INFO [Listener at localhost/38773] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 10:12:27,091 INFO [Listener at localhost/38773] ipc.NettyRpcServer(120): Bind to /172.31.2.10:43497 2023-07-14 10:12:27,091 INFO [Listener at localhost/38773] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 10:12:27,094 DEBUG [Listener at localhost/38773] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 10:12:27,095 INFO [Listener at localhost/38773] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 10:12:27,097 INFO [Listener at localhost/38773] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 10:12:27,098 INFO [Listener at localhost/38773] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43497 connecting to ZooKeeper ensemble=127.0.0.1:60034 2023-07-14 10:12:27,107 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:434970x0, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 10:12:27,108 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): regionserver:434970x0, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 10:12:27,109 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): regionserver:434970x0, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 10:12:27,110 DEBUG [Listener at localhost/38773] zookeeper.ZKUtil(164): regionserver:434970x0, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 10:12:27,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43497-0x1016343f0830003 connected 2023-07-14 10:12:27,114 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43497 2023-07-14 10:12:27,117 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43497 2023-07-14 10:12:27,118 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43497 2023-07-14 10:12:27,118 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43497 2023-07-14 10:12:27,119 DEBUG [Listener at localhost/38773] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43497 2023-07-14 10:12:27,121 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,39063,1689329545379 2023-07-14 10:12:27,133 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 10:12:27,135 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,39063,1689329545379 2023-07-14 10:12:27,160 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 10:12:27,160 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 10:12:27,161 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 10:12:27,162 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 10:12:27,163 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,39063,1689329545379 from backup master directory 2023-07-14 10:12:27,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 10:12:27,165 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 10:12:27,165 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 10:12:27,169 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,39063,1689329545379 2023-07-14 10:12:27,169 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 10:12:27,170 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 10:12:27,170 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,39063,1689329545379 2023-07-14 10:12:27,174 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-14 10:12:27,176 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-14 10:12:27,315 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/hbase.id with ID: bca94714-905e-4974-a665-19591b7e2fa3 2023-07-14 10:12:27,368 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 10:12:27,389 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 10:12:27,452 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6643fc6c to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:12:27,501 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@648c066b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:12:27,534 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 10:12:27,536 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-14 10:12:27,561 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-14 10:12:27,561 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-14 10:12:27,564 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 10:12:27,570 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 10:12:27,572 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 10:12:27,622 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/data/master/store-tmp 2023-07-14 10:12:27,702 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:27,702 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 10:12:27,702 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 10:12:27,703 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 10:12:27,703 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 10:12:27,703 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 10:12:27,703 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 10:12:27,703 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 10:12:27,705 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/WALs/jenkins-hbase9.apache.org,39063,1689329545379 2023-07-14 10:12:27,736 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39063%2C1689329545379, suffix=, logDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/WALs/jenkins-hbase9.apache.org,39063,1689329545379, archiveDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/oldWALs, maxLogs=10 2023-07-14 10:12:27,851 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45849,DS-8efe8c53-031a-4910-8b9d-7c8323f6945e,DISK] 2023-07-14 10:12:27,846 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45141,DS-6fe79f65-8523-4dd2-b7a3-d091e820b545,DISK] 2023-07-14 10:12:27,846 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42781,DS-ede41026-45f0-41aa-a07e-6acdce792b22,DISK] 2023-07-14 10:12:27,864 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-14 10:12:27,952 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/WALs/jenkins-hbase9.apache.org,39063,1689329545379/jenkins-hbase9.apache.org%2C39063%2C1689329545379.1689329547752 2023-07-14 10:12:27,958 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45849,DS-8efe8c53-031a-4910-8b9d-7c8323f6945e,DISK], DatanodeInfoWithStorage[127.0.0.1:45141,DS-6fe79f65-8523-4dd2-b7a3-d091e820b545,DISK], DatanodeInfoWithStorage[127.0.0.1:42781,DS-ede41026-45f0-41aa-a07e-6acdce792b22,DISK]] 2023-07-14 10:12:27,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-14 10:12:27,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:27,968 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 10:12:27,969 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 10:12:28,074 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-14 10:12:28,081 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-14 10:12:28,118 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-14 10:12:28,135 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:12:28,142 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 10:12:28,144 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 10:12:28,164 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 10:12:28,169 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:12:28,170 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67130591, jitterRate=3.2375752925872803E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:12:28,171 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 10:12:28,172 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-14 10:12:28,197 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-14 10:12:28,198 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-14 10:12:28,202 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-14 10:12:28,204 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-14 10:12:28,253 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 49 msec 2023-07-14 10:12:28,254 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-14 10:12:28,295 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-14 10:12:28,302 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-14 10:12:28,332 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-14 10:12:28,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-14 10:12:28,339 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-14 10:12:28,344 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-14 10:12:28,350 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-14 10:12:28,355 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 10:12:28,357 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-14 10:12:28,358 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-14 10:12:28,377 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-14 10:12:28,387 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 10:12:28,387 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 10:12:28,387 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 10:12:28,387 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 10:12:28,387 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 10:12:28,390 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,39063,1689329545379, sessionid=0x1016343f0830000, setting cluster-up flag (Was=false) 2023-07-14 10:12:28,417 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 10:12:28,427 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-14 10:12:28,428 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39063,1689329545379 2023-07-14 10:12:28,435 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 10:12:28,450 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-14 10:12:28,454 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,39063,1689329545379 2023-07-14 10:12:28,457 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp 2023-07-14 10:12:28,534 INFO [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(951): ClusterId : bca94714-905e-4974-a665-19591b7e2fa3 2023-07-14 10:12:28,538 INFO [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(951): ClusterId : bca94714-905e-4974-a665-19591b7e2fa3 2023-07-14 10:12:28,555 INFO [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(951): ClusterId : bca94714-905e-4974-a665-19591b7e2fa3 2023-07-14 10:12:28,559 DEBUG [RS:0;jenkins-hbase9:35921] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 10:12:28,561 DEBUG [RS:1;jenkins-hbase9:39405] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 10:12:28,561 DEBUG [RS:2;jenkins-hbase9:43497] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 10:12:28,570 DEBUG [RS:2;jenkins-hbase9:43497] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 10:12:28,570 DEBUG [RS:2;jenkins-hbase9:43497] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 10:12:28,573 DEBUG [RS:0;jenkins-hbase9:35921] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 10:12:28,573 DEBUG [RS:0;jenkins-hbase9:35921] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 10:12:28,574 DEBUG [RS:1;jenkins-hbase9:39405] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 10:12:28,574 DEBUG [RS:1;jenkins-hbase9:39405] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 10:12:28,579 DEBUG [RS:2;jenkins-hbase9:43497] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 10:12:28,579 DEBUG [RS:0;jenkins-hbase9:35921] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 10:12:28,579 DEBUG [RS:1;jenkins-hbase9:39405] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 10:12:28,582 DEBUG [RS:1;jenkins-hbase9:39405] zookeeper.ReadOnlyZKClient(139): Connect 0x210ba5b5 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:12:28,581 DEBUG [RS:2;jenkins-hbase9:43497] zookeeper.ReadOnlyZKClient(139): Connect 0x48048430 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:12:28,581 DEBUG [RS:0;jenkins-hbase9:35921] zookeeper.ReadOnlyZKClient(139): Connect 0x143df10f to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:12:28,605 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-14 10:12:28,622 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:12:28,622 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-14 10:12:28,625 DEBUG [RS:2;jenkins-hbase9:43497] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46c36340, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:12:28,626 DEBUG [RS:1;jenkins-hbase9:39405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fcc5fe4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:12:28,626 DEBUG [RS:2;jenkins-hbase9:43497] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42fcef40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 10:12:28,626 DEBUG [RS:1;jenkins-hbase9:39405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bf3cec5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 10:12:28,628 DEBUG [RS:0;jenkins-hbase9:35921] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1afa1df8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:12:28,629 DEBUG [RS:0;jenkins-hbase9:35921] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bc717c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 10:12:28,657 DEBUG [RS:1;jenkins-hbase9:39405] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:39405 2023-07-14 10:12:28,660 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:43497 2023-07-14 10:12:28,662 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:35921 2023-07-14 10:12:28,664 INFO [RS:2;jenkins-hbase9:43497] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 10:12:28,665 INFO [RS:2;jenkins-hbase9:43497] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 10:12:28,664 INFO [RS:0;jenkins-hbase9:35921] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 10:12:28,664 INFO [RS:1;jenkins-hbase9:39405] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 10:12:28,665 INFO [RS:0;jenkins-hbase9:35921] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 10:12:28,665 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 10:12:28,666 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 10:12:28,665 INFO [RS:1;jenkins-hbase9:39405] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 10:12:28,670 DEBUG [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 10:12:28,670 INFO [RS:2;jenkins-hbase9:43497] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:12:28,670 INFO [RS:0;jenkins-hbase9:35921] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:12:28,671 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 10:12:28,671 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 10:12:28,671 INFO [RS:1;jenkins-hbase9:39405] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:12:28,671 DEBUG [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 10:12:28,674 INFO [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39063,1689329545379 with isa=jenkins-hbase9.apache.org/172.31.2.10:35921, startcode=1689329546985 2023-07-14 10:12:28,674 INFO [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39063,1689329545379 with isa=jenkins-hbase9.apache.org/172.31.2.10:43497, startcode=1689329547088 2023-07-14 10:12:28,680 INFO [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39063,1689329545379 with isa=jenkins-hbase9.apache.org/172.31.2.10:39405, startcode=1689329547044 2023-07-14 10:12:28,699 DEBUG [RS:1;jenkins-hbase9:39405] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 10:12:28,700 DEBUG [RS:0;jenkins-hbase9:35921] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 10:12:28,699 DEBUG [RS:2;jenkins-hbase9:43497] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 10:12:28,764 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-14 10:12:28,778 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 10:12:28,778 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 10:12:28,778 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 10:12:28,778 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 10:12:28,779 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-14 10:12:28,779 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:28,779 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 10:12:28,779 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:28,795 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46621, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 10:12:28,795 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46643, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 10:12:28,795 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37771, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 10:12:28,811 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689329578810 2023-07-14 10:12:28,813 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-14 10:12:28,815 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39063] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 10:12:28,828 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 10:12:28,829 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-14 10:12:28,829 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-14 10:12:28,835 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 10:12:28,837 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39063] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 10:12:28,838 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39063] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 10:12:28,841 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-14 10:12:28,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-14 10:12:28,850 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-14 10:12:28,850 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-14 10:12:28,876 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:28,900 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 10:12:28,900 WARN [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 10:12:28,902 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 10:12:28,902 WARN [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 10:12:28,902 DEBUG [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 10:12:28,902 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-14 10:12:28,902 WARN [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 10:12:28,905 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-14 10:12:28,905 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-14 10:12:28,943 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-14 10:12:28,950 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-14 10:12:28,961 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689329548955,5,FailOnTimeoutGroup] 2023-07-14 10:12:28,990 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689329548962,5,FailOnTimeoutGroup] 2023-07-14 10:12:28,991 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:28,993 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-14 10:12:29,000 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,007 INFO [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39063,1689329545379 with isa=jenkins-hbase9.apache.org/172.31.2.10:43497, startcode=1689329547088 2023-07-14 10:12:29,008 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39063] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 10:12:29,011 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 10:12:29,011 WARN [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 200 ms and then retrying. 2023-07-14 10:12:29,013 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,013 INFO [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39063,1689329545379 with isa=jenkins-hbase9.apache.org/172.31.2.10:39405, startcode=1689329547044 2023-07-14 10:12:29,014 INFO [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39063,1689329545379 with isa=jenkins-hbase9.apache.org/172.31.2.10:35921, startcode=1689329546985 2023-07-14 10:12:29,015 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 10:12:29,016 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 10:12:29,017 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:12:29,024 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39063] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:29,030 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39063] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:29,046 DEBUG [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:12:29,047 DEBUG [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36399 2023-07-14 10:12:29,047 DEBUG [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 10:12:29,048 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:12:29,048 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36399 2023-07-14 10:12:29,048 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 10:12:29,074 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 10:12:29,075 DEBUG [RS:0;jenkins-hbase9:35921] zookeeper.ZKUtil(162): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:29,075 WARN [RS:0;jenkins-hbase9:35921] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 10:12:29,076 DEBUG [RS:1;jenkins-hbase9:39405] zookeeper.ZKUtil(162): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:29,076 INFO [RS:0;jenkins-hbase9:35921] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 10:12:29,076 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/WALs/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:29,076 WARN [RS:1;jenkins-hbase9:39405] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 10:12:29,087 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,35921,1689329546985] 2023-07-14 10:12:29,087 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,39405,1689329547044] 2023-07-14 10:12:29,085 INFO [RS:1;jenkins-hbase9:39405] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 10:12:29,096 DEBUG [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/WALs/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:29,144 DEBUG [RS:0;jenkins-hbase9:35921] zookeeper.ZKUtil(162): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:29,144 DEBUG [RS:1;jenkins-hbase9:39405] zookeeper.ZKUtil(162): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:29,145 DEBUG [RS:1;jenkins-hbase9:39405] zookeeper.ZKUtil(162): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:29,146 DEBUG [RS:0;jenkins-hbase9:35921] zookeeper.ZKUtil(162): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:29,152 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:29,158 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 10:12:29,160 DEBUG [RS:1;jenkins-hbase9:39405] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 10:12:29,160 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 10:12:29,161 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/info 2023-07-14 10:12:29,162 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 10:12:29,163 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:12:29,164 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 10:12:29,167 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/rep_barrier 2023-07-14 10:12:29,168 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 10:12:29,169 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:12:29,169 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 10:12:29,172 INFO [RS:1;jenkins-hbase9:39405] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 10:12:29,172 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/table 2023-07-14 10:12:29,172 INFO [RS:0;jenkins-hbase9:35921] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 10:12:29,173 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 10:12:29,175 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:12:29,180 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740 2023-07-14 10:12:29,191 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740 2023-07-14 10:12:29,196 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 10:12:29,199 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 10:12:29,212 INFO [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,39063,1689329545379 with isa=jenkins-hbase9.apache.org/172.31.2.10:43497, startcode=1689329547088 2023-07-14 10:12:29,214 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39063] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:29,238 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:12:29,238 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36399 2023-07-14 10:12:29,238 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 10:12:29,240 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 10:12:29,240 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 10:12:29,242 INFO [RS:0;jenkins-hbase9:35921] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 10:12:29,242 INFO [RS:1;jenkins-hbase9:39405] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 10:12:29,247 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:12:29,248 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 10:12:29,248 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,43497,1689329547088] 2023-07-14 10:12:29,249 DEBUG [RS:2;jenkins-hbase9:43497] zookeeper.ZKUtil(162): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:29,249 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65982093, jitterRate=-0.016790196299552917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 10:12:29,249 WARN [RS:2;jenkins-hbase9:43497] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 10:12:29,249 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 10:12:29,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:29,249 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 10:12:29,249 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 10:12:29,249 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 10:12:29,249 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 10:12:29,250 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 10:12:29,249 INFO [RS:2;jenkins-hbase9:43497] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 10:12:29,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:29,250 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/WALs/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:29,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:29,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:29,250 INFO [RS:1;jenkins-hbase9:39405] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 10:12:29,251 INFO [RS:1;jenkins-hbase9:39405] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:29,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:29,254 INFO [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 10:12:29,250 INFO [RS:0;jenkins-hbase9:35921] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 10:12:29,263 INFO [RS:0;jenkins-hbase9:35921] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,284 INFO [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 10:12:29,289 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 10:12:29,289 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 10:12:29,291 INFO [RS:1;jenkins-hbase9:39405] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,292 DEBUG [RS:1;jenkins-hbase9:39405] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,292 DEBUG [RS:1;jenkins-hbase9:39405] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,292 DEBUG [RS:1;jenkins-hbase9:39405] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,292 DEBUG [RS:1;jenkins-hbase9:39405] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,292 DEBUG [RS:1;jenkins-hbase9:39405] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,292 DEBUG [RS:1;jenkins-hbase9:39405] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 10:12:29,293 DEBUG [RS:1;jenkins-hbase9:39405] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,293 DEBUG [RS:2;jenkins-hbase9:43497] zookeeper.ZKUtil(162): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:29,294 DEBUG [RS:1;jenkins-hbase9:39405] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,294 DEBUG [RS:1;jenkins-hbase9:39405] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,294 DEBUG [RS:2;jenkins-hbase9:43497] zookeeper.ZKUtil(162): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:29,294 DEBUG [RS:1;jenkins-hbase9:39405] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,297 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 10:12:29,297 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-14 10:12:29,302 DEBUG [RS:2;jenkins-hbase9:43497] zookeeper.ZKUtil(162): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:29,303 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 10:12:29,304 INFO [RS:2;jenkins-hbase9:43497] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 10:12:29,304 INFO [RS:0;jenkins-hbase9:35921] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-14 10:12:29,313 INFO [RS:1;jenkins-hbase9:39405] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,322 DEBUG [RS:0;jenkins-hbase9:35921] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,322 INFO [RS:2;jenkins-hbase9:43497] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 10:12:29,323 DEBUG [RS:0;jenkins-hbase9:35921] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,323 INFO [RS:1;jenkins-hbase9:39405] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,323 DEBUG [RS:0;jenkins-hbase9:35921] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,323 INFO [RS:1;jenkins-hbase9:39405] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,323 DEBUG [RS:0;jenkins-hbase9:35921] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,324 DEBUG [RS:0;jenkins-hbase9:35921] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,324 DEBUG [RS:0;jenkins-hbase9:35921] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 10:12:29,324 DEBUG [RS:0;jenkins-hbase9:35921] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,324 DEBUG [RS:0;jenkins-hbase9:35921] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,324 DEBUG [RS:0;jenkins-hbase9:35921] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,324 DEBUG [RS:0;jenkins-hbase9:35921] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,349 INFO [RS:0;jenkins-hbase9:35921] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,361 INFO [RS:0;jenkins-hbase9:35921] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,361 INFO [RS:0;jenkins-hbase9:35921] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,374 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-14 10:12:29,381 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-14 10:12:29,387 INFO [RS:2;jenkins-hbase9:43497] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 10:12:29,387 INFO [RS:2;jenkins-hbase9:43497] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,389 INFO [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 10:12:29,398 INFO [RS:2;jenkins-hbase9:43497] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,399 DEBUG [RS:2;jenkins-hbase9:43497] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,399 DEBUG [RS:2;jenkins-hbase9:43497] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,399 DEBUG [RS:2;jenkins-hbase9:43497] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,399 DEBUG [RS:2;jenkins-hbase9:43497] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,399 DEBUG [RS:2;jenkins-hbase9:43497] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,399 DEBUG [RS:2;jenkins-hbase9:43497] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 10:12:29,400 DEBUG [RS:2;jenkins-hbase9:43497] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,400 DEBUG [RS:2;jenkins-hbase9:43497] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,400 DEBUG [RS:2;jenkins-hbase9:43497] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,400 DEBUG [RS:2;jenkins-hbase9:43497] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 10:12:29,406 INFO [RS:0;jenkins-hbase9:35921] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 10:12:29,409 INFO [RS:0;jenkins-hbase9:35921] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35921,1689329546985-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,406 INFO [RS:1;jenkins-hbase9:39405] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 10:12:29,414 INFO [RS:1;jenkins-hbase9:39405] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39405,1689329547044-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,415 INFO [RS:2;jenkins-hbase9:43497] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,416 INFO [RS:2;jenkins-hbase9:43497] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,416 INFO [RS:2;jenkins-hbase9:43497] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,464 INFO [RS:0;jenkins-hbase9:35921] regionserver.Replication(203): jenkins-hbase9.apache.org,35921,1689329546985 started 2023-07-14 10:12:29,465 INFO [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,35921,1689329546985, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:35921, sessionid=0x1016343f0830001 2023-07-14 10:12:29,465 INFO [RS:2;jenkins-hbase9:43497] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 10:12:29,465 INFO [RS:2;jenkins-hbase9:43497] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,43497,1689329547088-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:29,481 DEBUG [RS:0;jenkins-hbase9:35921] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 10:12:29,481 INFO [RS:1;jenkins-hbase9:39405] regionserver.Replication(203): jenkins-hbase9.apache.org,39405,1689329547044 started 2023-07-14 10:12:29,481 DEBUG [RS:0;jenkins-hbase9:35921] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:29,481 INFO [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,39405,1689329547044, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:39405, sessionid=0x1016343f0830002 2023-07-14 10:12:29,482 DEBUG [RS:1;jenkins-hbase9:39405] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 10:12:29,481 DEBUG [RS:0;jenkins-hbase9:35921] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35921,1689329546985' 2023-07-14 10:12:29,486 DEBUG [RS:0;jenkins-hbase9:35921] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 10:12:29,482 DEBUG [RS:1;jenkins-hbase9:39405] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:29,487 DEBUG [RS:1;jenkins-hbase9:39405] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39405,1689329547044' 2023-07-14 10:12:29,490 DEBUG [RS:1;jenkins-hbase9:39405] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 10:12:29,491 DEBUG [RS:1;jenkins-hbase9:39405] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 10:12:29,491 DEBUG [RS:1;jenkins-hbase9:39405] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 10:12:29,491 DEBUG [RS:1;jenkins-hbase9:39405] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 10:12:29,491 DEBUG [RS:1;jenkins-hbase9:39405] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:29,491 DEBUG [RS:1;jenkins-hbase9:39405] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39405,1689329547044' 2023-07-14 10:12:29,491 DEBUG [RS:1;jenkins-hbase9:39405] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:29,494 DEBUG [RS:1;jenkins-hbase9:39405] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:29,495 DEBUG [RS:1;jenkins-hbase9:39405] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 10:12:29,495 INFO [RS:1;jenkins-hbase9:39405] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 10:12:29,495 INFO [RS:1;jenkins-hbase9:39405] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 10:12:29,497 DEBUG [RS:0;jenkins-hbase9:35921] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 10:12:29,498 DEBUG [RS:0;jenkins-hbase9:35921] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 10:12:29,499 DEBUG [RS:0;jenkins-hbase9:35921] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 10:12:29,499 DEBUG [RS:0;jenkins-hbase9:35921] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:29,499 DEBUG [RS:0;jenkins-hbase9:35921] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35921,1689329546985' 2023-07-14 10:12:29,499 DEBUG [RS:0;jenkins-hbase9:35921] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:29,500 DEBUG [RS:0;jenkins-hbase9:35921] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:29,501 DEBUG [RS:0;jenkins-hbase9:35921] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 10:12:29,501 INFO [RS:0;jenkins-hbase9:35921] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 10:12:29,502 INFO [RS:0;jenkins-hbase9:35921] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 10:12:29,507 INFO [RS:2;jenkins-hbase9:43497] regionserver.Replication(203): jenkins-hbase9.apache.org,43497,1689329547088 started 2023-07-14 10:12:29,507 INFO [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,43497,1689329547088, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:43497, sessionid=0x1016343f0830003 2023-07-14 10:12:29,507 DEBUG [RS:2;jenkins-hbase9:43497] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 10:12:29,507 DEBUG [RS:2;jenkins-hbase9:43497] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:29,507 DEBUG [RS:2;jenkins-hbase9:43497] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43497,1689329547088' 2023-07-14 10:12:29,507 DEBUG [RS:2;jenkins-hbase9:43497] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 10:12:29,508 DEBUG [RS:2;jenkins-hbase9:43497] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 10:12:29,508 DEBUG [RS:2;jenkins-hbase9:43497] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 10:12:29,508 DEBUG [RS:2;jenkins-hbase9:43497] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 10:12:29,508 DEBUG [RS:2;jenkins-hbase9:43497] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:29,508 DEBUG [RS:2;jenkins-hbase9:43497] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,43497,1689329547088' 2023-07-14 10:12:29,509 DEBUG [RS:2;jenkins-hbase9:43497] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:29,509 DEBUG [RS:2;jenkins-hbase9:43497] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:29,510 DEBUG [RS:2;jenkins-hbase9:43497] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 10:12:29,510 INFO [RS:2;jenkins-hbase9:43497] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 10:12:29,510 INFO [RS:2;jenkins-hbase9:43497] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 10:12:29,534 DEBUG [jenkins-hbase9:39063] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-14 10:12:29,539 DEBUG [jenkins-hbase9:39063] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 10:12:29,546 DEBUG [jenkins-hbase9:39063] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 10:12:29,546 DEBUG [jenkins-hbase9:39063] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 10:12:29,546 DEBUG [jenkins-hbase9:39063] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 10:12:29,546 DEBUG [jenkins-hbase9:39063] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 10:12:29,550 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,35921,1689329546985, state=OPENING 2023-07-14 10:12:29,558 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-14 10:12:29,559 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 10:12:29,560 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 10:12:29,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:12:29,611 INFO [RS:0;jenkins-hbase9:35921] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35921%2C1689329546985, suffix=, logDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/WALs/jenkins-hbase9.apache.org,35921,1689329546985, archiveDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/oldWALs, maxLogs=32 2023-07-14 10:12:29,616 INFO [RS:2;jenkins-hbase9:43497] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C43497%2C1689329547088, suffix=, logDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/WALs/jenkins-hbase9.apache.org,43497,1689329547088, archiveDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/oldWALs, maxLogs=32 2023-07-14 10:12:29,632 INFO [RS:1;jenkins-hbase9:39405] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39405%2C1689329547044, suffix=, logDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/WALs/jenkins-hbase9.apache.org,39405,1689329547044, archiveDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/oldWALs, maxLogs=32 2023-07-14 10:12:29,671 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45849,DS-8efe8c53-031a-4910-8b9d-7c8323f6945e,DISK] 2023-07-14 10:12:29,672 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42781,DS-ede41026-45f0-41aa-a07e-6acdce792b22,DISK] 2023-07-14 10:12:29,687 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45141,DS-6fe79f65-8523-4dd2-b7a3-d091e820b545,DISK] 2023-07-14 10:12:29,751 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45849,DS-8efe8c53-031a-4910-8b9d-7c8323f6945e,DISK] 2023-07-14 10:12:29,758 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42781,DS-ede41026-45f0-41aa-a07e-6acdce792b22,DISK] 2023-07-14 10:12:29,772 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45141,DS-6fe79f65-8523-4dd2-b7a3-d091e820b545,DISK] 2023-07-14 10:12:29,790 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42781,DS-ede41026-45f0-41aa-a07e-6acdce792b22,DISK] 2023-07-14 10:12:29,794 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45141,DS-6fe79f65-8523-4dd2-b7a3-d091e820b545,DISK] 2023-07-14 10:12:29,795 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45849,DS-8efe8c53-031a-4910-8b9d-7c8323f6945e,DISK] 2023-07-14 10:12:29,810 INFO [RS:2;jenkins-hbase9:43497] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/WALs/jenkins-hbase9.apache.org,43497,1689329547088/jenkins-hbase9.apache.org%2C43497%2C1689329547088.1689329549619 2023-07-14 10:12:29,811 DEBUG [RS:2;jenkins-hbase9:43497] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45141,DS-6fe79f65-8523-4dd2-b7a3-d091e820b545,DISK], DatanodeInfoWithStorage[127.0.0.1:42781,DS-ede41026-45f0-41aa-a07e-6acdce792b22,DISK], DatanodeInfoWithStorage[127.0.0.1:45849,DS-8efe8c53-031a-4910-8b9d-7c8323f6945e,DISK]] 2023-07-14 10:12:29,826 INFO [RS:0;jenkins-hbase9:35921] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/WALs/jenkins-hbase9.apache.org,35921,1689329546985/jenkins-hbase9.apache.org%2C35921%2C1689329546985.1689329549617 2023-07-14 10:12:29,827 DEBUG [RS:0;jenkins-hbase9:35921] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42781,DS-ede41026-45f0-41aa-a07e-6acdce792b22,DISK], DatanodeInfoWithStorage[127.0.0.1:45141,DS-6fe79f65-8523-4dd2-b7a3-d091e820b545,DISK], DatanodeInfoWithStorage[127.0.0.1:45849,DS-8efe8c53-031a-4910-8b9d-7c8323f6945e,DISK]] 2023-07-14 10:12:29,829 INFO [RS:1;jenkins-hbase9:39405] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/WALs/jenkins-hbase9.apache.org,39405,1689329547044/jenkins-hbase9.apache.org%2C39405%2C1689329547044.1689329549634 2023-07-14 10:12:29,829 DEBUG [RS:1;jenkins-hbase9:39405] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45849,DS-8efe8c53-031a-4910-8b9d-7c8323f6945e,DISK], DatanodeInfoWithStorage[127.0.0.1:45141,DS-6fe79f65-8523-4dd2-b7a3-d091e820b545,DISK], DatanodeInfoWithStorage[127.0.0.1:42781,DS-ede41026-45f0-41aa-a07e-6acdce792b22,DISK]] 2023-07-14 10:12:29,832 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:29,836 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 10:12:29,841 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56112, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 10:12:29,878 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-14 10:12:29,878 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 10:12:29,895 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35921%2C1689329546985.meta, suffix=.meta, logDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/WALs/jenkins-hbase9.apache.org,35921,1689329546985, archiveDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/oldWALs, maxLogs=32 2023-07-14 10:12:29,928 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45141,DS-6fe79f65-8523-4dd2-b7a3-d091e820b545,DISK] 2023-07-14 10:12:29,934 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45849,DS-8efe8c53-031a-4910-8b9d-7c8323f6945e,DISK] 2023-07-14 10:12:29,934 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42781,DS-ede41026-45f0-41aa-a07e-6acdce792b22,DISK] 2023-07-14 10:12:29,946 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/WALs/jenkins-hbase9.apache.org,35921,1689329546985/jenkins-hbase9.apache.org%2C35921%2C1689329546985.meta.1689329549897.meta 2023-07-14 10:12:29,953 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45141,DS-6fe79f65-8523-4dd2-b7a3-d091e820b545,DISK], DatanodeInfoWithStorage[127.0.0.1:45849,DS-8efe8c53-031a-4910-8b9d-7c8323f6945e,DISK], DatanodeInfoWithStorage[127.0.0.1:42781,DS-ede41026-45f0-41aa-a07e-6acdce792b22,DISK]] 2023-07-14 10:12:29,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-14 10:12:29,955 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-14 10:12:29,957 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:12:29,959 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-14 10:12:29,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-14 10:12:29,976 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-14 10:12:29,997 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-14 10:12:29,997 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:29,997 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-14 10:12:29,997 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-14 10:12:30,006 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 10:12:30,009 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/info 2023-07-14 10:12:30,011 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/info 2023-07-14 10:12:30,012 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 10:12:30,013 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:12:30,013 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 10:12:30,016 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/rep_barrier 2023-07-14 10:12:30,016 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/rep_barrier 2023-07-14 10:12:30,016 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 10:12:30,019 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:12:30,020 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 10:12:30,021 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/table 2023-07-14 10:12:30,022 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/table 2023-07-14 10:12:30,022 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 10:12:30,023 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:12:30,026 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740 2023-07-14 10:12:30,031 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740 2023-07-14 10:12:30,036 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 10:12:30,038 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 10:12:30,040 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67495652, jitterRate=0.005763590335845947}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 10:12:30,044 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 10:12:30,059 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689329549809 2023-07-14 10:12:30,090 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-14 10:12:30,091 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,35921,1689329546985, state=OPEN 2023-07-14 10:12:30,094 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-14 10:12:30,095 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-14 10:12:30,096 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 10:12:30,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-14 10:12:30,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,35921,1689329546985 in 530 msec 2023-07-14 10:12:30,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-14 10:12:30,138 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 809 msec 2023-07-14 10:12:30,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5050 sec 2023-07-14 10:12:30,149 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689329550149, completionTime=-1 2023-07-14 10:12:30,149 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-14 10:12:30,149 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-14 10:12:30,266 DEBUG [hconnection-0x52ff4eb1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:12:30,271 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:12:30,293 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-14 10:12:30,293 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689329610293 2023-07-14 10:12:30,293 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689329670293 2023-07-14 10:12:30,293 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 143 msec 2023-07-14 10:12:30,334 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39063,1689329545379-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:30,335 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39063,1689329545379-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:30,335 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39063,1689329545379-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:30,338 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:39063, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:30,338 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-14 10:12:30,348 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-14 10:12:30,359 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-14 10:12:30,360 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 10:12:30,373 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-14 10:12:30,376 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 10:12:30,380 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 10:12:30,407 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93 2023-07-14 10:12:30,410 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93 empty. 2023-07-14 10:12:30,411 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93 2023-07-14 10:12:30,411 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-14 10:12:30,509 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-14 10:12:30,511 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3a1db46edb9b173bb9b26f17faccad93, NAME => 'hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:12:30,557 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:30,557 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 3a1db46edb9b173bb9b26f17faccad93, disabling compactions & flushes 2023-07-14 10:12:30,557 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:12:30,557 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:12:30,557 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. after waiting 0 ms 2023-07-14 10:12:30,557 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:12:30,558 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:12:30,558 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 3a1db46edb9b173bb9b26f17faccad93: 2023-07-14 10:12:30,562 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 10:12:30,584 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689329550569"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329550569"}]},"ts":"1689329550569"} 2023-07-14 10:12:30,623 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 10:12:30,626 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 10:12:30,632 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329550626"}]},"ts":"1689329550626"} 2023-07-14 10:12:30,638 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-14 10:12:30,646 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 10:12:30,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 10:12:30,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 10:12:30,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 10:12:30,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 10:12:30,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3a1db46edb9b173bb9b26f17faccad93, ASSIGN}] 2023-07-14 10:12:30,668 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3a1db46edb9b173bb9b26f17faccad93, ASSIGN 2023-07-14 10:12:30,675 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3a1db46edb9b173bb9b26f17faccad93, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43497,1689329547088; forceNewPlan=false, retain=false 2023-07-14 10:12:30,828 INFO [jenkins-hbase9:39063] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 10:12:30,829 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3a1db46edb9b173bb9b26f17faccad93, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:30,830 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689329550829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329550829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329550829"}]},"ts":"1689329550829"} 2023-07-14 10:12:30,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3a1db46edb9b173bb9b26f17faccad93, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:12:30,998 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:30,999 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 10:12:31,002 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 10:12:31,018 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:12:31,018 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a1db46edb9b173bb9b26f17faccad93, NAME => 'hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93.', STARTKEY => '', ENDKEY => ''} 2023-07-14 10:12:31,020 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. service=AccessControlService 2023-07-14 10:12:31,021 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:12:31,021 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3a1db46edb9b173bb9b26f17faccad93 2023-07-14 10:12:31,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:31,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3a1db46edb9b173bb9b26f17faccad93 2023-07-14 10:12:31,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3a1db46edb9b173bb9b26f17faccad93 2023-07-14 10:12:31,025 INFO [StoreOpener-3a1db46edb9b173bb9b26f17faccad93-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3a1db46edb9b173bb9b26f17faccad93 2023-07-14 10:12:31,028 DEBUG [StoreOpener-3a1db46edb9b173bb9b26f17faccad93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93/info 2023-07-14 10:12:31,028 DEBUG [StoreOpener-3a1db46edb9b173bb9b26f17faccad93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93/info 2023-07-14 10:12:31,029 INFO [StoreOpener-3a1db46edb9b173bb9b26f17faccad93-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a1db46edb9b173bb9b26f17faccad93 columnFamilyName info 2023-07-14 10:12:31,030 INFO [StoreOpener-3a1db46edb9b173bb9b26f17faccad93-1] regionserver.HStore(310): Store=3a1db46edb9b173bb9b26f17faccad93/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:12:31,032 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93 2023-07-14 10:12:31,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93 2023-07-14 10:12:31,040 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3a1db46edb9b173bb9b26f17faccad93 2023-07-14 10:12:31,045 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:12:31,046 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3a1db46edb9b173bb9b26f17faccad93; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68349787, jitterRate=0.018491193652153015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:12:31,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3a1db46edb9b173bb9b26f17faccad93: 2023-07-14 10:12:31,049 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93., pid=6, masterSystemTime=1689329550998 2023-07-14 10:12:31,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:12:31,057 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:12:31,059 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3a1db46edb9b173bb9b26f17faccad93, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:31,059 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689329551058"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329551058"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329551058"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329551058"}]},"ts":"1689329551058"} 2023-07-14 10:12:31,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-14 10:12:31,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3a1db46edb9b173bb9b26f17faccad93, server=jenkins-hbase9.apache.org,43497,1689329547088 in 232 msec 2023-07-14 10:12:31,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-14 10:12:31,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3a1db46edb9b173bb9b26f17faccad93, ASSIGN in 411 msec 2023-07-14 10:12:31,077 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 10:12:31,077 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329551077"}]},"ts":"1689329551077"} 2023-07-14 10:12:31,080 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-14 10:12:31,085 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 10:12:31,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 723 msec 2023-07-14 10:12:31,177 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-14 10:12:31,180 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-14 10:12:31,180 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 10:12:31,208 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:12:31,210 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:12:31,226 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-14 10:12:31,250 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 10:12:31,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 41 msec 2023-07-14 10:12:31,282 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-14 10:12:31,298 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 10:12:31,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 36 msec 2023-07-14 10:12:31,324 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-14 10:12:31,328 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-14 10:12:31,328 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.158sec 2023-07-14 10:12:31,332 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-14 10:12:31,335 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-14 10:12:31,335 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-14 10:12:31,337 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39063,1689329545379-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-14 10:12:31,338 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39063,1689329545379-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-14 10:12:31,360 DEBUG [Listener at localhost/38773] zookeeper.ReadOnlyZKClient(139): Connect 0x44e82ad3 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:12:31,372 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 10:12:31,375 DEBUG [Listener at localhost/38773] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@276e1f5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:12:31,375 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-14 10:12:31,378 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 10:12:31,383 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 10:12:31,389 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-14 10:12:31,398 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c 2023-07-14 10:12:31,400 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c empty. 2023-07-14 10:12:31,403 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c 2023-07-14 10:12:31,403 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-14 10:12:31,403 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 10:12:31,410 DEBUG [hconnection-0x58da017a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:12:31,458 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:12:31,463 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,39063,1689329545379 2023-07-14 10:12:31,463 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-14 10:12:31,464 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/test.cache.data in system properties and HBase conf 2023-07-14 10:12:31,464 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 10:12:31,464 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop.log.dir in system properties and HBase conf 2023-07-14 10:12:31,465 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 10:12:31,465 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 10:12:31,465 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 10:12:31,465 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 10:12:31,466 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 10:12:31,466 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 10:12:31,466 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 10:12:31,466 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 10:12:31,466 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 10:12:31,466 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 10:12:31,467 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 10:12:31,467 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 10:12:31,467 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/nfs.dump.dir in system properties and HBase conf 2023-07-14 10:12:31,467 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/java.io.tmpdir in system properties and HBase conf 2023-07-14 10:12:31,467 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 10:12:31,467 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 10:12:31,468 INFO [Listener at localhost/38773] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-14 10:12:31,470 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-14 10:12:31,489 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2d522901cedf9b58bda29b84a423cc3c, NAME => 'hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:12:31,508 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 10:12:31,554 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:31,555 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 2d522901cedf9b58bda29b84a423cc3c, disabling compactions & flushes 2023-07-14 10:12:31,555 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:12:31,555 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:12:31,555 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. after waiting 0 ms 2023-07-14 10:12:31,555 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:12:31,555 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:12:31,555 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 2d522901cedf9b58bda29b84a423cc3c: 2023-07-14 10:12:31,560 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 10:12:31,566 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689329551565"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329551565"}]},"ts":"1689329551565"} 2023-07-14 10:12:31,576 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 10:12:31,578 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 10:12:31,578 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329551578"}]},"ts":"1689329551578"} 2023-07-14 10:12:31,581 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-14 10:12:31,585 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 10:12:31,587 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 10:12:31,587 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 10:12:31,587 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 10:12:31,587 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 10:12:31,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2d522901cedf9b58bda29b84a423cc3c, ASSIGN}] 2023-07-14 10:12:31,591 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2d522901cedf9b58bda29b84a423cc3c, ASSIGN 2023-07-14 10:12:31,593 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=2d522901cedf9b58bda29b84a423cc3c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35921,1689329546985; forceNewPlan=false, retain=false 2023-07-14 10:12:31,709 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 10:12:31,744 INFO [jenkins-hbase9:39063] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 10:12:31,746 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2d522901cedf9b58bda29b84a423cc3c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:31,746 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689329551745"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329551745"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329551745"}]},"ts":"1689329551745"} 2023-07-14 10:12:31,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 2d522901cedf9b58bda29b84a423cc3c, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:12:31,928 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:12:31,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d522901cedf9b58bda29b84a423cc3c, NAME => 'hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c.', STARTKEY => '', ENDKEY => ''} 2023-07-14 10:12:31,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. service=AccessControlService 2023-07-14 10:12:31,930 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:12:31,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 2d522901cedf9b58bda29b84a423cc3c 2023-07-14 10:12:31,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:31,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2d522901cedf9b58bda29b84a423cc3c 2023-07-14 10:12:31,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2d522901cedf9b58bda29b84a423cc3c 2023-07-14 10:12:31,942 INFO [StoreOpener-2d522901cedf9b58bda29b84a423cc3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 2d522901cedf9b58bda29b84a423cc3c 2023-07-14 10:12:31,946 DEBUG [StoreOpener-2d522901cedf9b58bda29b84a423cc3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c/l 2023-07-14 10:12:31,946 DEBUG [StoreOpener-2d522901cedf9b58bda29b84a423cc3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c/l 2023-07-14 10:12:31,947 INFO [StoreOpener-2d522901cedf9b58bda29b84a423cc3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d522901cedf9b58bda29b84a423cc3c columnFamilyName l 2023-07-14 10:12:31,952 INFO [StoreOpener-2d522901cedf9b58bda29b84a423cc3c-1] regionserver.HStore(310): Store=2d522901cedf9b58bda29b84a423cc3c/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:12:31,957 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c 2023-07-14 10:12:31,964 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c 2023-07-14 10:12:31,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2d522901cedf9b58bda29b84a423cc3c 2023-07-14 10:12:31,986 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:12:31,987 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2d522901cedf9b58bda29b84a423cc3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75453575, jitterRate=0.12434588372707367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:12:31,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2d522901cedf9b58bda29b84a423cc3c: 2023-07-14 10:12:31,990 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c., pid=11, masterSystemTime=1689329551920 2023-07-14 10:12:31,998 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:12:31,998 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:12:31,999 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2d522901cedf9b58bda29b84a423cc3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:31,999 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689329551999"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329551999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329551999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329551999"}]},"ts":"1689329551999"} 2023-07-14 10:12:32,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-14 10:12:32,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 2d522901cedf9b58bda29b84a423cc3c, server=jenkins-hbase9.apache.org,35921,1689329546985 in 242 msec 2023-07-14 10:12:32,011 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 10:12:32,020 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 10:12:32,020 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329552020"}]},"ts":"1689329552020"} 2023-07-14 10:12:32,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-14 10:12:32,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=2d522901cedf9b58bda29b84a423cc3c, ASSIGN in 424 msec 2023-07-14 10:12:32,023 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-14 10:12:32,032 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 10:12:32,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 659 msec 2023-07-14 10:12:32,512 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 10:12:32,512 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-14 10:12:32,594 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-14 10:12:33,488 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 10:12:33,930 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 10:12:33,952 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_37187_jobhistory____.dvn434/webapp 2023-07-14 10:12:34,201 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-14 10:12:34,201 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-14 10:12:34,202 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 10:12:34,206 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 10:12:34,346 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 10:12:34,834 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 10:12:35,374 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-14 10:12:35,483 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:37187 2023-07-14 10:12:35,678 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 10:12:35,840 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-14 10:12:35,841 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-14 10:12:35,842 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-14 10:12:35,844 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:12:35,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-14 10:12:35,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:12:35,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-14 10:12:35,846 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 10:12:35,846 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-14 10:12:35,846 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:12:35,846 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-14 10:12:35,846 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 10:12:35,846 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-14 10:12:36,658 WARN [Listener at jenkins-hbase9.apache.org/43147] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 10:12:36,802 WARN [Listener at jenkins-hbase9.apache.org/43147] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 10:12:36,803 INFO [Listener at jenkins-hbase9.apache.org/43147] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 10:12:36,823 INFO [Listener at jenkins-hbase9.apache.org/43147] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_38839_cluster____rrh8c0/webapp 2023-07-14 10:12:36,939 INFO [Listener at jenkins-hbase9.apache.org/43147] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 10:12:36,940 INFO [Listener at jenkins-hbase9.apache.org/43147] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-14 10:12:36,940 INFO [Listener at jenkins-hbase9.apache.org/43147] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 10:12:36,942 INFO [Listener at jenkins-hbase9.apache.org/43147] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 10:12:36,963 INFO [Listener at jenkins-hbase9.apache.org/43147] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 10:12:37,228 INFO [Listener at jenkins-hbase9.apache.org/43147] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 10:12:37,378 INFO [Listener at jenkins-hbase9.apache.org/43147] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 10:12:37,390 INFO [Listener at jenkins-hbase9.apache.org/43147] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:38839 2023-07-14 10:12:38,124 WARN [Listener at jenkins-hbase9.apache.org/36767] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 10:12:38,177 WARN [Listener at jenkins-hbase9.apache.org/36767] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 10:12:38,178 INFO [Listener at jenkins-hbase9.apache.org/36767] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 10:12:38,192 INFO [Listener at jenkins-hbase9.apache.org/36767] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_38703_node____.d9opiq/webapp 2023-07-14 10:12:38,305 INFO [Listener at jenkins-hbase9.apache.org/36767] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 10:12:38,305 INFO [Listener at jenkins-hbase9.apache.org/36767] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 10:12:38,306 INFO [Listener at jenkins-hbase9.apache.org/36767] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 10:12:38,306 INFO [Listener at jenkins-hbase9.apache.org/36767] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 10:12:38,321 INFO [Listener at jenkins-hbase9.apache.org/36767] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 10:12:38,351 INFO [Listener at jenkins-hbase9.apache.org/36767] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 10:12:38,477 INFO [Listener at jenkins-hbase9.apache.org/36767] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 10:12:38,508 INFO [Listener at jenkins-hbase9.apache.org/36767] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:38703 2023-07-14 10:12:38,902 WARN [Listener at jenkins-hbase9.apache.org/39497] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 10:12:38,912 WARN [Listener at jenkins-hbase9.apache.org/39497] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 10:12:38,913 INFO [Listener at jenkins-hbase9.apache.org/39497] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 10:12:38,923 INFO [Listener at jenkins-hbase9.apache.org/39497] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_45777_node____.os5629/webapp 2023-07-14 10:12:38,975 INFO [Listener at jenkins-hbase9.apache.org/39497] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 10:12:38,976 INFO [Listener at jenkins-hbase9.apache.org/39497] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 10:12:38,976 INFO [Listener at jenkins-hbase9.apache.org/39497] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 10:12:38,976 INFO [Listener at jenkins-hbase9.apache.org/39497] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 10:12:38,985 INFO [Listener at jenkins-hbase9.apache.org/39497] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 10:12:39,002 INFO [Listener at jenkins-hbase9.apache.org/39497] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 10:12:39,095 INFO [Listener at jenkins-hbase9.apache.org/39497] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 10:12:39,126 INFO [Listener at jenkins-hbase9.apache.org/39497] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:45777 2023-07-14 10:12:39,164 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-14 10:12:39,166 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:12:39,257 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=525, ProcessCount=184, AvailableMemoryMB=4568 2023-07-14 10:12:39,257 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-14 10:12:39,275 DEBUG [Listener at jenkins-hbase9.apache.org/39497] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 10:12:39,283 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 10:12:39,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 10:12:39,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-14 10:12:39,300 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 10:12:39,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-14 10:12:39,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 10:12:39,303 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 10:12:39,308 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:12:39,308 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65 2023-07-14 10:12:39,309 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65 empty. 2023-07-14 10:12:39,309 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7 empty. 2023-07-14 10:12:39,311 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:12:39,311 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65 2023-07-14 10:12:39,311 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 10:12:39,345 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-14 10:12:39,351 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => ca3716268b8c1df1ecacdaf7be7974d7, NAME => 'testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:12:39,352 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => f6365b00172b727eae39eb3168079e65, NAME => 'testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:12:39,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 10:12:39,460 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:39,463 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing ca3716268b8c1df1ecacdaf7be7974d7, disabling compactions & flushes 2023-07-14 10:12:39,463 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:39,463 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:39,463 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. after waiting 0 ms 2023-07-14 10:12:39,463 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:39,463 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:39,463 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for ca3716268b8c1df1ecacdaf7be7974d7: 2023-07-14 10:12:39,466 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:39,466 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing f6365b00172b727eae39eb3168079e65, disabling compactions & flushes 2023-07-14 10:12:39,467 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:12:39,467 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:12:39,467 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. after waiting 0 ms 2023-07-14 10:12:39,467 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:12:39,467 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:12:39,467 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for f6365b00172b727eae39eb3168079e65: 2023-07-14 10:12:39,471 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 10:12:39,472 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689329559472"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329559472"}]},"ts":"1689329559472"} 2023-07-14 10:12:39,473 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689329559472"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329559472"}]},"ts":"1689329559472"} 2023-07-14 10:12:39,523 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 10:12:39,525 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 10:12:39,525 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329559525"}]},"ts":"1689329559525"} 2023-07-14 10:12:39,527 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-14 10:12:39,534 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 10:12:39,536 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 10:12:39,536 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 10:12:39,536 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 10:12:39,536 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 10:12:39,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ca3716268b8c1df1ecacdaf7be7974d7, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6365b00172b727eae39eb3168079e65, ASSIGN}] 2023-07-14 10:12:39,539 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ca3716268b8c1df1ecacdaf7be7974d7, ASSIGN 2023-07-14 10:12:39,540 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6365b00172b727eae39eb3168079e65, ASSIGN 2023-07-14 10:12:39,541 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6365b00172b727eae39eb3168079e65, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35921,1689329546985; forceNewPlan=false, retain=false 2023-07-14 10:12:39,541 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ca3716268b8c1df1ecacdaf7be7974d7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43497,1689329547088; forceNewPlan=false, retain=false 2023-07-14 10:12:39,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 10:12:39,691 INFO [jenkins-hbase9:39063] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 10:12:39,694 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ca3716268b8c1df1ecacdaf7be7974d7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:39,694 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f6365b00172b727eae39eb3168079e65, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:39,695 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689329559694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329559694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329559694"}]},"ts":"1689329559694"} 2023-07-14 10:12:39,695 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689329559694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329559694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329559694"}]},"ts":"1689329559694"} 2023-07-14 10:12:39,698 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure f6365b00172b727eae39eb3168079e65, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:12:39,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure ca3716268b8c1df1ecacdaf7be7974d7, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:12:39,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:39,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca3716268b8c1df1ecacdaf7be7974d7, NAME => 'testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 10:12:39,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. service=AccessControlService 2023-07-14 10:12:39,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:12:39,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:12:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:12:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f6365b00172b727eae39eb3168079e65, NAME => 'testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 10:12:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:12:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:12:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. service=AccessControlService 2023-07-14 10:12:39,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:12:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f6365b00172b727eae39eb3168079e65 2023-07-14 10:12:39,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:12:39,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f6365b00172b727eae39eb3168079e65 2023-07-14 10:12:39,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f6365b00172b727eae39eb3168079e65 2023-07-14 10:12:39,894 INFO [StoreOpener-ca3716268b8c1df1ecacdaf7be7974d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:12:39,898 INFO [StoreOpener-f6365b00172b727eae39eb3168079e65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f6365b00172b727eae39eb3168079e65 2023-07-14 10:12:39,904 DEBUG [StoreOpener-f6365b00172b727eae39eb3168079e65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/cf 2023-07-14 10:12:39,904 DEBUG [StoreOpener-f6365b00172b727eae39eb3168079e65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/cf 2023-07-14 10:12:39,904 DEBUG [StoreOpener-ca3716268b8c1df1ecacdaf7be7974d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/cf 2023-07-14 10:12:39,904 DEBUG [StoreOpener-ca3716268b8c1df1ecacdaf7be7974d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/cf 2023-07-14 10:12:39,904 INFO [StoreOpener-ca3716268b8c1df1ecacdaf7be7974d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca3716268b8c1df1ecacdaf7be7974d7 columnFamilyName cf 2023-07-14 10:12:39,904 INFO [StoreOpener-f6365b00172b727eae39eb3168079e65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6365b00172b727eae39eb3168079e65 columnFamilyName cf 2023-07-14 10:12:39,905 INFO [StoreOpener-ca3716268b8c1df1ecacdaf7be7974d7-1] regionserver.HStore(310): Store=ca3716268b8c1df1ecacdaf7be7974d7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:12:39,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:12:39,910 INFO [StoreOpener-f6365b00172b727eae39eb3168079e65-1] regionserver.HStore(310): Store=f6365b00172b727eae39eb3168079e65/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:12:39,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:12:39,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65 2023-07-14 10:12:39,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65 2023-07-14 10:12:39,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f6365b00172b727eae39eb3168079e65 2023-07-14 10:12:39,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:12:39,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:12:39,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 10:12:39,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f6365b00172b727eae39eb3168079e65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67703746, jitterRate=0.008864432573318481}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:12:39,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f6365b00172b727eae39eb3168079e65: 2023-07-14 10:12:39,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:12:39,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65., pid=15, masterSystemTime=1689329559855 2023-07-14 10:12:39,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ca3716268b8c1df1ecacdaf7be7974d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61390254, jitterRate=-0.08521392941474915}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:12:39,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ca3716268b8c1df1ecacdaf7be7974d7: 2023-07-14 10:12:39,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7., pid=16, masterSystemTime=1689329559857 2023-07-14 10:12:39,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:12:39,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:12:39,956 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f6365b00172b727eae39eb3168079e65, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:39,957 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689329559956"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329559956"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329559956"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329559956"}]},"ts":"1689329559956"} 2023-07-14 10:12:39,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:39,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:39,958 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ca3716268b8c1df1ecacdaf7be7974d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:39,960 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689329559958"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329559958"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329559958"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329559958"}]},"ts":"1689329559958"} 2023-07-14 10:12:39,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-14 10:12:39,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure f6365b00172b727eae39eb3168079e65, server=jenkins-hbase9.apache.org,35921,1689329546985 in 263 msec 2023-07-14 10:12:39,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6365b00172b727eae39eb3168079e65, ASSIGN in 430 msec 2023-07-14 10:12:39,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-14 10:12:39,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure ca3716268b8c1df1ecacdaf7be7974d7, server=jenkins-hbase9.apache.org,43497,1689329547088 in 266 msec 2023-07-14 10:12:39,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-14 10:12:39,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ca3716268b8c1df1ecacdaf7be7974d7, ASSIGN in 441 msec 2023-07-14 10:12:39,981 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 10:12:39,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329559981"}]},"ts":"1689329559981"} 2023-07-14 10:12:39,984 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-14 10:12:39,987 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 10:12:39,994 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-14 10:12:40,019 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 10:12:40,062 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 10:12:40,062 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 10:12:40,062 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 10:12:40,062 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 10:12:40,062 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 10:12:40,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 10:12:40,074 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 10:12:40,074 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 10:12:40,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 10:12:40,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 779 msec 2023-07-14 10:12:40,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 10:12:40,447 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-14 10:12:40,447 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-14 10:12:40,448 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:12:40,454 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-14 10:12:40,455 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:12:40,455 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-14 10:12:40,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 10:12:40,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329560469 (current time:1689329560469). 2023-07-14 10:12:40,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:12:40,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x30786d92 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:12:40,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74daecb2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:12:40,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:12:40,479 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:12:40,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30786d92 to 127.0.0.1:60034 2023-07-14 10:12:40,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:12:40,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x7501d067 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:12:40,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5319dc04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:12:40,489 DEBUG [hconnection-0x2134ad69-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:12:40,492 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:12:40,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7501d067 to 127.0.0.1:60034 2023-07-14 10:12:40,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:12:40,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 10:12:40,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:12:40,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 10:12:40,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 10:12:40,545 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 10:12:40,546 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689330160546 2023-07-14 10:12:40,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 10:12:40,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 10:12:40,549 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 10:12:40,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 10:12:40,552 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-14 10:12:40,554 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 10:12:40,555 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689330160555 2023-07-14 10:12:40,555 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:12:40,556 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:12:40,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,592 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-14 10:12:40,592 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:12:40,593 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 10:12:40,593 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 10:12:40,593 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,593 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,599 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:40,599 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:40,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:40,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:40,599 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:40,599 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:40,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:40,599 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:40,600 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,602 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,602 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:12:40,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 10:12:40,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 10:12:40,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 10:12:40,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,603 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 10:12:40,603 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 10:12:40,603 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 10:12:40,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,607 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 10:12:40,607 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:12:40,607 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 10:12:40,608 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 10:12:40,608 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:12:40,607 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 10:12:40,609 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 10:12:40,609 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 10:12:40,608 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 10:12:40,609 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 10:12:40,609 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 10:12:40,609 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:12:40,610 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 10:12:40,610 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 10:12:40,611 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 10:12:40,613 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:12:40,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:12:40,614 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,614 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:12:40,614 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,614 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:12:40,615 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:40,615 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,615 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,615 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:12:40,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:12:40,615 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,616 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:12:40,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:40,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:40,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:12:40,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 10:12:40,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77cc3a39[Count = 1] remaining members to acquire global barrier 2023-07-14 10:12:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:12:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:12:40,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:12:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:12:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:40,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:40,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:12:40,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 10:12:40,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77cc3a39[Count = 0] remaining members to acquire global barrier 2023-07-14 10:12:40,621 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 10:12:40,621 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,628 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,628 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,628 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 10:12:40,628 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,628 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,629 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 10:12:40,629 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 10:12:40,629 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 10:12:40,629 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:12:40,629 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:40,630 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:12:40,629 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:12:40,630 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:12:40,630 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:12:40,630 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:12:40,630 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:12:40,630 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:40,630 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. started... 2023-07-14 10:12:40,635 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. started... 2023-07-14 10:12:40,635 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 10:12:40,635 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:12:40,635 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 10:12:40,639 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f6365b00172b727eae39eb3168079e65: 2023-07-14 10:12:40,639 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca3716268b8c1df1ecacdaf7be7974d7: 2023-07-14 10:12:40,640 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,640 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,649 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:12:40,653 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:12:40,654 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:12:40,654 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:12:40,656 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:12:40,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 10:12:40,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:12:40,664 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:12:40,694 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. completed. 2023-07-14 10:12:40,695 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:40,695 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:12:40,695 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:12:40,695 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,695 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 10:12:40,696 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:12:40,698 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 10:12:40,698 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,698 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:12:40,698 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 10:12:40,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:12:40,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:12:40,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:12:40,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:12:40,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:40,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:40,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:12:40,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:40,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,43497,1689329547088': 2023-07-14 10:12:40,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 10:12:40,864 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:12:40,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 10:12:40,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:12:40,866 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:12:41,097 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. completed. 2023-07-14 10:12:41,097 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:12:41,097 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:12:41,097 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:12:41,097 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,097 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 10:12:41,097 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:12:41,099 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,099 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 10:12:41,100 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:12:41,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,100 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 10:12:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:12:41,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:12:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:12:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:12:41,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:41,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:12:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:41,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,35921,1689329546985': 2023-07-14 10:12:41,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 10:12:41,108 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-14 10:12:41,108 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:12:41,109 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:12:41,109 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,109 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:12:41,113 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,113 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,113 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,113 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:41,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,113 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:41,113 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:12:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:12:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,113 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:41,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:12:41,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:41,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:41,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:41,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:41,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:41,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:41,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:12:41,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,118 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,119 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,120 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:41,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:12:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,122 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:41,124 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,125 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:41,143 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:41,143 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:41,143 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:41,143 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,143 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,143 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:41,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:41,143 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:41,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:41,143 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:41,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:41,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:41,144 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,144 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:12:41,144 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,144 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:41,144 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:41,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,144 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:41,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:41,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:41,144 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:41,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:41,145 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:41,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:41,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:41,145 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,146 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,146 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,166 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:12:41,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 10:12:41,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:12:41,169 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 10:12:41,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,258 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 10:12:41,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,259 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 10:12:41,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689329560547Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689329561144 (+597 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689329561144Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689329561165 (+21 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689329561191 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689329561258 (+67 ms) 2023-07-14 10:12:41,260 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 10:12:41,264 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 711 msec 2023-07-14 10:12:41,669 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:12:41,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 10:12:41,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:12:41,693 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:12:41,697 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:12:41,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35921] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:12:41,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43497] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:12:41,709 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 10:12:41,710 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:41,712 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:12:41,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 10:12:41,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329561745 (current time:1689329561745). 2023-07-14 10:12:41,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:12:41,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x1edfadfc to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:12:41,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@111a056c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:12:41,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:12:41,759 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:12:41,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1edfadfc to 127.0.0.1:60034 2023-07-14 10:12:41,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:12:41,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x453e92dc to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:12:41,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26ed77ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:12:41,779 DEBUG [hconnection-0x671d371e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:12:41,783 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:12:41,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x453e92dc to 127.0.0.1:60034 2023-07-14 10:12:41,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:12:41,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 10:12:41,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:12:41,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 10:12:41,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 10:12:41,795 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 10:12:41,796 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689330161796 2023-07-14 10:12:41,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 10:12:41,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 10:12:41,797 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:12:41,797 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:12:41,799 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 10:12:41,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 10:12:41,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-14 10:12:41,802 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 10:12:41,803 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689330161803 2023-07-14 10:12:41,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-14 10:12:41,822 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-14 10:12:41,822 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:12:41,822 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 10:12:41,822 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 10:12:41,823 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,823 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,825 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:41,825 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:41,825 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,825 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:41,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:41,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:41,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:41,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:41,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:41,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:41,825 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,825 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,826 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,826 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:12:41,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 10:12:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 10:12:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 10:12:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,827 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 10:12:41,827 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 10:12:41,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 10:12:41,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 10:12:41,828 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 10:12:41,828 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 10:12:41,828 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:12:41,828 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:12:41,829 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 10:12:41,830 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 10:12:41,830 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 10:12:41,830 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 10:12:41,830 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 10:12:41,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 10:12:41,830 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 10:12:41,830 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 10:12:41,830 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 10:12:41,830 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:12:41,831 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 10:12:41,831 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 10:12:41,831 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 10:12:41,833 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,833 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:12:41,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:12:41,835 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,835 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:12:41,835 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,835 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:12:41,835 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,835 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,835 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:12:41,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:12:41,836 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,836 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:12:41,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 10:12:41,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:41,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:12:41,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 10:12:41,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9a6e0a8[Count = 1] remaining members to acquire global barrier 2023-07-14 10:12:41,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:12:41,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:12:41,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:12:41,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:12:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 10:12:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:12:41,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 10:12:41,842 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 10:12:41,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9a6e0a8[Count = 0] remaining members to acquire global barrier 2023-07-14 10:12:41,842 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,843 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-14 10:12:41,846 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,846 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,846 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,846 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:41,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,846 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 10:12:41,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:41,847 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 10:12:41,847 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:12:41,847 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:41,847 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:12:41,847 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:12:41,847 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:12:41,847 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:41,847 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:12:41,847 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. started... 2023-07-14 10:12:41,847 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 10:12:41,847 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:12:41,847 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 10:12:41,847 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ca3716268b8c1df1ecacdaf7be7974d7 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-14 10:12:41,847 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. started... 2023-07-14 10:12:41,847 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:12:41,848 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f6365b00172b727eae39eb3168079e65 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-14 10:12:41,850 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 10:12:41,850 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:12:41,850 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 10:12:41,898 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:12:41,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 10:12:41,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:12:41,900 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:12:41,982 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/.tmp/cf/ff989fa1eed8425ebe8d5d417a12e219 2023-07-14 10:12:41,984 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/.tmp/cf/a801d8b05aae4ac49381c20e58710163 2023-07-14 10:12:42,057 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/.tmp/cf/a801d8b05aae4ac49381c20e58710163 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/cf/a801d8b05aae4ac49381c20e58710163 2023-07-14 10:12:42,058 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/.tmp/cf/ff989fa1eed8425ebe8d5d417a12e219 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/cf/ff989fa1eed8425ebe8d5d417a12e219 2023-07-14 10:12:42,076 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/cf/ff989fa1eed8425ebe8d5d417a12e219, entries=2, sequenceid=6, filesize=5.0 K 2023-07-14 10:12:42,079 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for ca3716268b8c1df1ecacdaf7be7974d7 in 232ms, sequenceid=6, compaction requested=false 2023-07-14 10:12:42,081 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca3716268b8c1df1ecacdaf7be7974d7: 2023-07-14 10:12:42,081 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 10:12:42,082 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:12:42,082 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/cf/ff989fa1eed8425ebe8d5d417a12e219] hfiles 2023-07-14 10:12:42,082 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/cf/ff989fa1eed8425ebe8d5d417a12e219 for snapshot=snaptb0-testExportWithTargetName 2023-07-14 10:12:42,082 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/cf/a801d8b05aae4ac49381c20e58710163, entries=48, sequenceid=6, filesize=8.1 K 2023-07-14 10:12:42,090 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for f6365b00172b727eae39eb3168079e65 in 242ms, sequenceid=6, compaction requested=false 2023-07-14 10:12:42,091 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f6365b00172b727eae39eb3168079e65: 2023-07-14 10:12:42,091 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 10:12:42,091 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:12:42,091 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/cf/a801d8b05aae4ac49381c20e58710163] hfiles 2023-07-14 10:12:42,091 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/cf/a801d8b05aae4ac49381c20e58710163 for snapshot=snaptb0-testExportWithTargetName 2023-07-14 10:12:42,100 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:12:42,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 10:12:42,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:12:42,104 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:12:42,122 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. completed. 2023-07-14 10:12:42,122 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:12:42,123 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:12:42,123 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:12:42,123 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,123 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 10:12:42,123 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:12:42,127 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:12:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:12:42,127 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 10:12:42,128 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:12:42,128 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 10:12:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:12:42,129 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. completed. 2023-07-14 10:12:42,129 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:12:42,129 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:12:42,129 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:12:42,129 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,129 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 10:12:42,129 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:12:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:12:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 10:12:42,131 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,131 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 10:12:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,131 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:12:42,132 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 10:12:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:12:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 10:12:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,43497,1689329547088': 2023-07-14 10:12:42,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 10:12:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:12:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:12:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:12:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:12:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 10:12:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:12:42,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 10:12:42,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:42,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,35921,1689329546985': 2023-07-14 10:12:42,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 10:12:42,141 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-14 10:12:42,141 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:12:42,141 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:12:42,142 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-14 10:12:42,142 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:12:42,144 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,144 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:42,144 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,144 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:42,144 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:12:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:12:42,144 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:12:42,145 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:42,145 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:42,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:42,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,146 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 10:12:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,150 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:12:42,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 10:12:42,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:42,158 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:12:42,159 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 10:12:42,160 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:42,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:42,175 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:42,175 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:42,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:42,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:42,175 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:12:42,175 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,175 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:42,175 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:42,175 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,175 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-14 10:12:42,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-14 10:12:42,175 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:12:42,177 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:42,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:42,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:42,176 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:42,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:42,176 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:12:42,177 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:12:42,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:12:42,177 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:12:42,178 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,178 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:12:42,178 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:12:42,178 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,178 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:42,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:42,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:12:42,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:12:42,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 10:12:42,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,317 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 10:12:42,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689329561797Consolidate snapshot: snaptb0-testExportWithTargetName at 1689329562176 (+379 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689329562177 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689329562185 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689329562203 (+18 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689329562317 (+114 ms) 2023-07-14 10:12:42,320 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 10:12:42,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 522 msec 2023-07-14 10:12:42,405 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:12:42,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 10:12:42,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:12:42,409 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329562409 2023-07-14 10:12:42,409 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36399, tgtDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329562409, rawTgtDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329562409, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:12:42,488 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:12:42,488 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_580741834_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329562409, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329562409/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 10:12:42,488 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-14 10:12:42,553 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329562409/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 10:12:42,628 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:42,629 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:42,630 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:42,630 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:43,720 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-5761677539529476609.jar 2023-07-14 10:12:43,721 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:43,722 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:43,792 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-6719943059739750913.jar 2023-07-14 10:12:43,793 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:43,793 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:43,794 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:43,794 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:43,795 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:43,795 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 10:12:43,795 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 10:12:43,796 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 10:12:43,796 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 10:12:43,797 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 10:12:43,797 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 10:12:43,798 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 10:12:43,798 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 10:12:43,799 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 10:12:43,799 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 10:12:43,800 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 10:12:43,805 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:12:43,805 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:12:43,806 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:12:43,806 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:12:43,806 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:12:43,807 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:12:43,807 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:12:44,775 WARN [Listener at jenkins-hbase9.apache.org/39497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 10:12:44,782 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-14 10:12:44,793 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 10:12:45,413 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 10:12:45,522 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:12:45,523 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:12:45,948 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0001_000001 (auth:SIMPLE) 2023-07-14 10:12:52,585 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0001_000001 (auth:SIMPLE) 2023-07-14 10:12:55,003 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0001_000001 (auth:SIMPLE) 2023-07-14 10:12:58,427 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0001_000001 (auth:SIMPLE) 2023-07-14 10:13:00,113 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 10:13:00,114 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 10:13:00,141 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-14 10:13:00,141 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 10:13:00,142 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 10:13:00,143 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 10:13:00,146 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-14 10:13:00,146 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-14 10:13:00,146 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329562409/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329562409/.hbase-snapshot/testExportWithTargetName 2023-07-14 10:13:00,147 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329562409/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-14 10:13:00,147 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329562409/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-14 10:13:00,177 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-14 10:13:00,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-07-14 10:13:00,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-14 10:13:00,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329580212"}]},"ts":"1689329580212"} 2023-07-14 10:13:00,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 10:13:00,214 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-14 10:13:00,216 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-14 10:13:00,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ca3716268b8c1df1ecacdaf7be7974d7, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6365b00172b727eae39eb3168079e65, UNASSIGN}] 2023-07-14 10:13:00,225 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ca3716268b8c1df1ecacdaf7be7974d7, UNASSIGN 2023-07-14 10:13:00,226 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6365b00172b727eae39eb3168079e65, UNASSIGN 2023-07-14 10:13:00,227 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ca3716268b8c1df1ecacdaf7be7974d7, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:00,227 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f6365b00172b727eae39eb3168079e65, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:00,228 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689329580227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329580227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329580227"}]},"ts":"1689329580227"} 2023-07-14 10:13:00,228 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689329580227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329580227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329580227"}]},"ts":"1689329580227"} 2023-07-14 10:13:00,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure ca3716268b8c1df1ecacdaf7be7974d7, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:13:00,236 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure f6365b00172b727eae39eb3168079e65, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:13:00,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 10:13:00,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f6365b00172b727eae39eb3168079e65 2023-07-14 10:13:00,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f6365b00172b727eae39eb3168079e65, disabling compactions & flushes 2023-07-14 10:13:00,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:13:00,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:13:00,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. after waiting 0 ms 2023-07-14 10:13:00,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:13:00,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:13:00,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ca3716268b8c1df1ecacdaf7be7974d7, disabling compactions & flushes 2023-07-14 10:13:00,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:13:00,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:13:00,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. after waiting 0 ms 2023-07-14 10:13:00,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:13:00,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:13:00,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:13:00,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:13:00,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:13:00,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65. 2023-07-14 10:13:00,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7. 2023-07-14 10:13:00,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f6365b00172b727eae39eb3168079e65: 2023-07-14 10:13:00,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ca3716268b8c1df1ecacdaf7be7974d7: 2023-07-14 10:13:00,445 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f6365b00172b727eae39eb3168079e65, regionState=CLOSED 2023-07-14 10:13:00,445 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689329580444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329580444"}]},"ts":"1689329580444"} 2023-07-14 10:13:00,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f6365b00172b727eae39eb3168079e65 2023-07-14 10:13:00,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:13:00,448 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ca3716268b8c1df1ecacdaf7be7974d7, regionState=CLOSED 2023-07-14 10:13:00,448 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689329580448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329580448"}]},"ts":"1689329580448"} 2023-07-14 10:13:00,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-14 10:13:00,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure f6365b00172b727eae39eb3168079e65, server=jenkins-hbase9.apache.org,35921,1689329546985 in 212 msec 2023-07-14 10:13:00,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-14 10:13:00,454 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f6365b00172b727eae39eb3168079e65, UNASSIGN in 233 msec 2023-07-14 10:13:00,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure ca3716268b8c1df1ecacdaf7be7974d7, server=jenkins-hbase9.apache.org,43497,1689329547088 in 217 msec 2023-07-14 10:13:00,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-14 10:13:00,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ca3716268b8c1df1ecacdaf7be7974d7, UNASSIGN in 235 msec 2023-07-14 10:13:00,459 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329580459"}]},"ts":"1689329580459"} 2023-07-14 10:13:00,461 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-14 10:13:00,464 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-14 10:13:00,467 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 274 msec 2023-07-14 10:13:00,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 10:13:00,515 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-14 10:13:00,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-07-14 10:13:00,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 10:13:00,530 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 10:13:00,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-14 10:13:00,534 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 10:13:00,536 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-14 10:13:00,538 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 10:13:00,538 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 10:13:00,538 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 10:13:00,538 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 10:13:00,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 10:13:00,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 10:13:00,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 10:13:00,541 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-14 10:13:00,542 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 10:13:00,542 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 10:13:00,542 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 10:13:00,542 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:00,542 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:00,542 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:00,542 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 10:13:00,542 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:00,543 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:13:00,546 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65 2023-07-14 10:13:00,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 10:13:00,550 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/recovered.edits] 2023-07-14 10:13:00,552 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/recovered.edits] 2023-07-14 10:13:00,559 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/cf/ff989fa1eed8425ebe8d5d417a12e219 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/cf/ff989fa1eed8425ebe8d5d417a12e219 2023-07-14 10:13:00,559 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/cf/a801d8b05aae4ac49381c20e58710163 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/cf/a801d8b05aae4ac49381c20e58710163 2023-07-14 10:13:00,565 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65/recovered.edits/9.seqid 2023-07-14 10:13:00,566 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7/recovered.edits/9.seqid 2023-07-14 10:13:00,567 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/f6365b00172b727eae39eb3168079e65 2023-07-14 10:13:00,567 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportWithTargetName/ca3716268b8c1df1ecacdaf7be7974d7 2023-07-14 10:13:00,567 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 10:13:00,570 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 10:13:00,595 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-14 10:13:00,598 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-14 10:13:00,600 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 10:13:00,600 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-14 10:13:00,600 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329580600"}]},"ts":"9223372036854775807"} 2023-07-14 10:13:00,600 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329580600"}]},"ts":"9223372036854775807"} 2023-07-14 10:13:00,602 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 10:13:00,603 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ca3716268b8c1df1ecacdaf7be7974d7, NAME => 'testtb-testExportWithTargetName,,1689329559292.ca3716268b8c1df1ecacdaf7be7974d7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f6365b00172b727eae39eb3168079e65, NAME => 'testtb-testExportWithTargetName,1,1689329559292.f6365b00172b727eae39eb3168079e65.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 10:13:00,603 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-14 10:13:00,603 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689329580603"}]},"ts":"9223372036854775807"} 2023-07-14 10:13:00,605 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-14 10:13:00,609 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 10:13:00,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 88 msec 2023-07-14 10:13:00,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 10:13:00,648 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-14 10:13:00,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-14 10:13:00,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-14 10:13:00,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-07-14 10:13:00,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-14 10:13:00,711 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=751 (was 706) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1721114370_1 at /127.0.0.1:36958 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1109605716) connection to jenkins-hbase9.apache.org/172.31.2.10:46035 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1109605716) connection to jenkins-hbase9.apache.org/172.31.2.10:41287 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:42818 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1721114370_1 at /127.0.0.1:42794 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:41598 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:36978 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=680 (was 525) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=2855 (was 4568) 2023-07-14 10:13:00,711 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-14 10:13:00,735 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=680, ProcessCount=190, AvailableMemoryMB=2853 2023-07-14 10:13:00,736 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-14 10:13:00,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 10:13:00,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-14 10:13:00,742 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 10:13:00,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-14 10:13:00,743 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 10:13:00,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 10:13:00,746 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:00,746 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:00,746 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d empty. 2023-07-14 10:13:00,747 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22 empty. 2023-07-14 10:13:00,747 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:00,747 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:00,747 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 10:13:00,768 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 10:13:00,770 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 06ca941b9c30e49fee028ab20f34994d, NAME => 'testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:13:00,770 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 818b94bb96b8e7a84e4bedc2368f3d22, NAME => 'testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:13:00,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:13:00,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 818b94bb96b8e7a84e4bedc2368f3d22, disabling compactions & flushes 2023-07-14 10:13:00,796 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:00,796 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:00,797 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. after waiting 0 ms 2023-07-14 10:13:00,797 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:00,797 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:00,797 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 818b94bb96b8e7a84e4bedc2368f3d22: 2023-07-14 10:13:00,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:13:00,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 06ca941b9c30e49fee028ab20f34994d, disabling compactions & flushes 2023-07-14 10:13:00,799 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:00,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:00,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. after waiting 0 ms 2023-07-14 10:13:00,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:00,799 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:00,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 06ca941b9c30e49fee028ab20f34994d: 2023-07-14 10:13:00,802 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 10:13:00,803 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689329580803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329580803"}]},"ts":"1689329580803"} 2023-07-14 10:13:00,803 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689329580803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329580803"}]},"ts":"1689329580803"} 2023-07-14 10:13:00,806 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 10:13:00,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 10:13:00,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329580807"}]},"ts":"1689329580807"} 2023-07-14 10:13:00,809 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 10:13:00,812 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 10:13:00,813 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 10:13:00,813 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 10:13:00,813 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 10:13:00,813 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 10:13:00,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=06ca941b9c30e49fee028ab20f34994d, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=818b94bb96b8e7a84e4bedc2368f3d22, ASSIGN}] 2023-07-14 10:13:00,815 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=818b94bb96b8e7a84e4bedc2368f3d22, ASSIGN 2023-07-14 10:13:00,815 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=06ca941b9c30e49fee028ab20f34994d, ASSIGN 2023-07-14 10:13:00,816 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=818b94bb96b8e7a84e4bedc2368f3d22, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35921,1689329546985; forceNewPlan=false, retain=false 2023-07-14 10:13:00,816 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=06ca941b9c30e49fee028ab20f34994d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39405,1689329547044; forceNewPlan=false, retain=false 2023-07-14 10:13:00,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 10:13:00,967 INFO [jenkins-hbase9:39063] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 10:13:00,970 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=818b94bb96b8e7a84e4bedc2368f3d22, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:00,970 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=06ca941b9c30e49fee028ab20f34994d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:00,970 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689329580970"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329580970"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329580970"}]},"ts":"1689329580970"} 2023-07-14 10:13:00,970 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689329580970"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329580970"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329580970"}]},"ts":"1689329580970"} 2023-07-14 10:13:00,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 818b94bb96b8e7a84e4bedc2368f3d22, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:13:00,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 06ca941b9c30e49fee028ab20f34994d, server=jenkins-hbase9.apache.org,39405,1689329547044}] 2023-07-14 10:13:01,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 10:13:01,128 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,129 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 10:13:01,133 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 10:13:01,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:01,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 818b94bb96b8e7a84e4bedc2368f3d22, NAME => 'testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 10:13:01,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. service=AccessControlService 2023-07-14 10:13:01,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:13:01,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:01,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:13:01,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:01,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:01,137 INFO [StoreOpener-818b94bb96b8e7a84e4bedc2368f3d22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:01,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:01,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 06ca941b9c30e49fee028ab20f34994d, NAME => 'testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 10:13:01,139 DEBUG [StoreOpener-818b94bb96b8e7a84e4bedc2368f3d22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/cf 2023-07-14 10:13:01,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. service=AccessControlService 2023-07-14 10:13:01,139 DEBUG [StoreOpener-818b94bb96b8e7a84e4bedc2368f3d22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/cf 2023-07-14 10:13:01,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:13:01,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:01,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:13:01,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:01,139 INFO [StoreOpener-818b94bb96b8e7a84e4bedc2368f3d22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 818b94bb96b8e7a84e4bedc2368f3d22 columnFamilyName cf 2023-07-14 10:13:01,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:01,140 INFO [StoreOpener-818b94bb96b8e7a84e4bedc2368f3d22-1] regionserver.HStore(310): Store=818b94bb96b8e7a84e4bedc2368f3d22/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:13:01,142 INFO [StoreOpener-06ca941b9c30e49fee028ab20f34994d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:01,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:01,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:01,144 DEBUG [StoreOpener-06ca941b9c30e49fee028ab20f34994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/cf 2023-07-14 10:13:01,144 DEBUG [StoreOpener-06ca941b9c30e49fee028ab20f34994d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/cf 2023-07-14 10:13:01,144 INFO [StoreOpener-06ca941b9c30e49fee028ab20f34994d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06ca941b9c30e49fee028ab20f34994d columnFamilyName cf 2023-07-14 10:13:01,145 INFO [StoreOpener-06ca941b9c30e49fee028ab20f34994d-1] regionserver.HStore(310): Store=06ca941b9c30e49fee028ab20f34994d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:13:01,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:01,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:01,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:01,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:13:01,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 818b94bb96b8e7a84e4bedc2368f3d22; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64886595, jitterRate=-0.03311438858509064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:13:01,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 818b94bb96b8e7a84e4bedc2368f3d22: 2023-07-14 10:13:01,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:01,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22., pid=30, masterSystemTime=1689329581126 2023-07-14 10:13:01,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:01,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:01,156 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=818b94bb96b8e7a84e4bedc2368f3d22, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:13:01,156 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689329581156"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329581156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329581156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329581156"}]},"ts":"1689329581156"} 2023-07-14 10:13:01,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 06ca941b9c30e49fee028ab20f34994d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70781658, jitterRate=0.05472889542579651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:13:01,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 06ca941b9c30e49fee028ab20f34994d: 2023-07-14 10:13:01,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d., pid=31, masterSystemTime=1689329581128 2023-07-14 10:13:01,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:01,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:01,164 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=06ca941b9c30e49fee028ab20f34994d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,165 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689329581163"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329581163"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329581163"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329581163"}]},"ts":"1689329581163"} 2023-07-14 10:13:01,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-14 10:13:01,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 818b94bb96b8e7a84e4bedc2368f3d22, server=jenkins-hbase9.apache.org,35921,1689329546985 in 188 msec 2023-07-14 10:13:01,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=818b94bb96b8e7a84e4bedc2368f3d22, ASSIGN in 352 msec 2023-07-14 10:13:01,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-14 10:13:01,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 06ca941b9c30e49fee028ab20f34994d, server=jenkins-hbase9.apache.org,39405,1689329547044 in 192 msec 2023-07-14 10:13:01,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-14 10:13:01,175 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=06ca941b9c30e49fee028ab20f34994d, ASSIGN in 359 msec 2023-07-14 10:13:01,176 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 10:13:01,176 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329581176"}]},"ts":"1689329581176"} 2023-07-14 10:13:01,178 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 10:13:01,182 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 10:13:01,183 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-14 10:13:01,186 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 10:13:01,188 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:01,188 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:01,188 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:01,189 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:01,191 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:01,191 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:01,191 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:01,191 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:01,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 10:13:01,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 10:13:01,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 10:13:01,192 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 10:13:01,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 452 msec 2023-07-14 10:13:01,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 10:13:01,347 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-14 10:13:01,347 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-14 10:13:01,348 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:13:01,354 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-14 10:13:01,355 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:13:01,355 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-14 10:13:01,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:13:01,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329581360 (current time:1689329581360). 2023-07-14 10:13:01,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:13:01,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x4aa8c577 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:13:01,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7508cb83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:13:01,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:13:01,379 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:13:01,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4aa8c577 to 127.0.0.1:60034 2023-07-14 10:13:01,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:13:01,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x411dfb1b to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:13:01,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d920d32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:13:01,388 DEBUG [hconnection-0x7ef583d0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:13:01,389 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:13:01,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x411dfb1b to 127.0.0.1:60034 2023-07-14 10:13:01,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:13:01,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 10:13:01,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:13:01,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:13:01,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:13:01,398 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:13:01,399 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689330181399 2023-07-14 10:13:01,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:13:01,399 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 10:13:01,400 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:13:01,400 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:13:01,403 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:13:01,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 10:13:01,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-14 10:13:01,405 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 10:13:01,406 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689330181406 2023-07-14 10:13:01,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,430 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-14 10:13:01,430 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:01,432 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 10:13:01,432 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 10:13:01,433 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,433 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,434 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,434 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,434 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,434 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,435 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,435 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,436 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,436 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 10:13:01,437 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 10:13:01,437 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:01,436 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,437 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 10:13:01,437 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:01,439 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 10:13:01,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,439 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 10:13:01,439 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 10:13:01,439 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 10:13:01,439 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 10:13:01,439 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 10:13:01,439 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:01,439 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 10:13:01,440 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 10:13:01,440 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 10:13:01,440 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 10:13:01,441 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,441 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:01,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:01,446 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,446 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,446 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,446 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,446 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:01,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:01,446 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,446 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:01,446 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,446 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:01,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:01,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:01,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 10:13:01,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2945f2d6[Count = 1] remaining members to acquire global barrier 2023-07-14 10:13:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:01,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:01,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:01,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 10:13:01,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2945f2d6[Count = 0] remaining members to acquire global barrier 2023-07-14 10:13:01,452 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 10:13:01,452 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,453 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,453 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,453 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,453 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,453 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:13:01,453 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:13:01,453 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:13:01,454 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 10:13:01,454 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:13:01,454 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,454 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:13:01,454 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:13:01,454 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:13:01,454 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:01,454 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:13:01,454 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:01,454 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. started... 2023-07-14 10:13:01,454 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:13:01,454 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. started... 2023-07-14 10:13:01,455 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 06ca941b9c30e49fee028ab20f34994d: 2023-07-14 10:13:01,456 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 818b94bb96b8e7a84e4bedc2368f3d22: 2023-07-14 10:13:01,456 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 10:13:01,456 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:01,456 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,457 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,457 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:13:01,457 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:13:01,458 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:13:01,456 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 10:13:01,458 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:13:01,476 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. completed. 2023-07-14 10:13:01,477 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:01,477 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:13:01,477 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:13:01,477 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,477 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 10:13:01,477 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:13:01,478 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. completed. 2023-07-14 10:13:01,478 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:01,478 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:13:01,478 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:13:01,478 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,478 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 10:13:01,478 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:13:01,479 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,479 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 10:13:01,479 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:01,479 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 10:13:01,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:01,481 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,481 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 10:13:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:01,481 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:01,481 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 10:13:01,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:01,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:01,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:01,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,39405,1689329547044': 2023-07-14 10:13:01,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 10:13:01,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:01,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:01,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:01,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:01,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:01,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,35921,1689329546985': 2023-07-14 10:13:01,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 10:13:01,494 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-14 10:13:01,494 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:13:01,494 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:13:01,494 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,494 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:13:01,497 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,497 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,497 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,497 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,499 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:01,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:01,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:01,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:01,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:01,500 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,500 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,500 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:01,501 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,501 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:13:01,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:13:01,502 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:01,502 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:13:01,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:01,505 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,506 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,507 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,512 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,512 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,512 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,512 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:01,513 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,513 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:01,514 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,514 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,514 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,514 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,514 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:01,514 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,514 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,514 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,514 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:01,514 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,514 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,516 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,514 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,516 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 10:13:01,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,621 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:01,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689329581399Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689329581516 (+117 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689329581517 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689329581524 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689329581553 (+29 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689329581620 (+67 ms) 2023-07-14 10:13:01,625 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 10:13:01,629 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 226 msec 2023-07-14 10:13:01,703 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:01,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:13:01,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:13:01,714 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:13:01,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35921] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:13:01,723 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:13:01,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39405] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:13:01,726 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 10:13:01,726 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:01,728 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:13:01,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:13:01,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329581742 (current time:1689329581742). 2023-07-14 10:13:01,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:13:01,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x210588b3 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:13:01,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e21a4cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:13:01,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:13:01,753 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:13:01,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x210588b3 to 127.0.0.1:60034 2023-07-14 10:13:01,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:13:01,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x40f28563 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:13:01,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e9b1f68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:13:01,764 DEBUG [hconnection-0x4ebca8b1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:13:01,766 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:13:01,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40f28563 to 127.0.0.1:60034 2023-07-14 10:13:01,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:13:01,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 10:13:01,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:13:01,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:13:01,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:13:01,777 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:13:01,778 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689330181778 2023-07-14 10:13:01,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:13:01,778 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 10:13:01,780 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:13:01,780 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:13:01,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 10:13:01,782 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:13:01,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-14 10:13:01,784 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 10:13:01,784 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689330181784 2023-07-14 10:13:01,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-14 10:13:01,801 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-14 10:13:01,801 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:01,802 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 10:13:01,802 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 10:13:01,803 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,803 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,804 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,804 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,804 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,804 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,805 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,805 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,805 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,806 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,806 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:13:01,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 10:13:01,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,806 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 10:13:01,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 10:13:01,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 10:13:01,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 10:13:01,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,807 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 10:13:01,807 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:01,807 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 10:13:01,808 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 10:13:01,808 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 10:13:01,807 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 10:13:01,808 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 10:13:01,808 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 10:13:01,809 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 10:13:01,809 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:01,809 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 10:13:01,810 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 10:13:01,810 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 10:13:01,810 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:01,810 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 10:13:01,811 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 10:13:01,811 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 10:13:01,811 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 10:13:01,811 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 10:13:01,814 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,814 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:01,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:01,814 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,815 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,815 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,815 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,815 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,815 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:01,815 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:01,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:01,815 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,816 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 10:13:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:01,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 10:13:01,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f4e1835[Count = 1] remaining members to acquire global barrier 2023-07-14 10:13:01,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:01,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:01,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:01,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 10:13:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:01,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 10:13:01,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f4e1835[Count = 0] remaining members to acquire global barrier 2023-07-14 10:13:01,820 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 10:13:01,820 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,821 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,821 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,822 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,822 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:13:01,822 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:13:01,822 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 10:13:01,822 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:13:01,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,822 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:13:01,822 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:13:01,822 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:13:01,822 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,822 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:01,823 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. started... 2023-07-14 10:13:01,823 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 06ca941b9c30e49fee028ab20f34994d 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 10:13:01,823 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:13:01,823 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:13:01,823 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:01,823 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. started... 2023-07-14 10:13:01,824 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 818b94bb96b8e7a84e4bedc2368f3d22 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 10:13:01,824 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,824 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:13:01,826 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 10:13:01,826 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:01,826 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 10:13:01,863 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/.tmp/cf/fe96ae3da90e4cbea2cd1c2479b74fdf 2023-07-14 10:13:01,864 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/.tmp/cf/20b662c98c8a409c8adc10477781cd28 2023-07-14 10:13:01,878 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/.tmp/cf/20b662c98c8a409c8adc10477781cd28 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/cf/20b662c98c8a409c8adc10477781cd28 2023-07-14 10:13:01,879 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/.tmp/cf/fe96ae3da90e4cbea2cd1c2479b74fdf as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/cf/fe96ae3da90e4cbea2cd1c2479b74fdf 2023-07-14 10:13:01,880 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:01,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:13:01,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:13:01,888 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:13:01,893 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/cf/20b662c98c8a409c8adc10477781cd28, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 10:13:01,895 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 06ca941b9c30e49fee028ab20f34994d in 72ms, sequenceid=6, compaction requested=false 2023-07-14 10:13:01,895 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-14 10:13:01,896 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 06ca941b9c30e49fee028ab20f34994d: 2023-07-14 10:13:01,896 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 10:13:01,896 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:13:01,896 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/cf/20b662c98c8a409c8adc10477781cd28] hfiles 2023-07-14 10:13:01,896 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/cf/20b662c98c8a409c8adc10477781cd28 for snapshot=snaptb0-testExportFileSystemState 2023-07-14 10:13:01,899 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/cf/fe96ae3da90e4cbea2cd1c2479b74fdf, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 10:13:01,901 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 818b94bb96b8e7a84e4bedc2368f3d22 in 76ms, sequenceid=6, compaction requested=false 2023-07-14 10:13:01,902 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 818b94bb96b8e7a84e4bedc2368f3d22: 2023-07-14 10:13:01,902 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 10:13:01,903 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:13:01,903 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/cf/fe96ae3da90e4cbea2cd1c2479b74fdf] hfiles 2023-07-14 10:13:01,903 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/cf/fe96ae3da90e4cbea2cd1c2479b74fdf for snapshot=snaptb0-testExportFileSystemState 2023-07-14 10:13:01,915 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. completed. 2023-07-14 10:13:01,915 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:01,915 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:13:01,915 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:13:01,916 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,921 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 10:13:01,922 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:13:01,926 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 10:13:01,926 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:01,926 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 10:13:01,926 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:01,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:01,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:01,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:01,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 10:13:01,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:01,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 10:13:01,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,39405,1689329547044': 2023-07-14 10:13:01,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 10:13:01,939 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. completed. 2023-07-14 10:13:01,939 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:01,939 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:13:01,939 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:13:01,939 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,939 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 10:13:01,939 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:13:01,941 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,941 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 10:13:01,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:01,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:01,941 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:01,941 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 10:13:01,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:01,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:01,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 10:13:01,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:01,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 10:13:01,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,35921,1689329546985': 2023-07-14 10:13:01,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 10:13:01,947 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-14 10:13:01,947 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:13:01,947 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:13:01,947 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-14 10:13:01,948 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:13:01,950 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,950 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,950 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,950 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,950 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,950 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,950 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:01,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,950 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:01,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:01,951 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 10:13:01,951 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 10:13:01,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:01,954 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 10:13:01,954 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,955 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,959 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,959 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,959 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,959 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,959 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,959 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,959 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:01,961 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:01,961 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,961 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:01,963 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:01,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,961 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:01,961 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-14 10:13:01,963 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:01,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-14 10:13:01,963 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:01,963 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:01,964 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:01,964 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,964 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:01,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 10:13:01,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:01,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:02,009 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 10:13:02,089 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:02,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:13:02,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:13:02,091 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:13:02,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 10:13:02,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 10:13:02,131 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 10:13:02,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689329581779Consolidate snapshot: snaptb0-testExportFileSystemState at 1689329581963 (+184 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689329581963Writing data manifest for snaptb0-testExportFileSystemState at 1689329581972 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689329581998 (+26 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689329582130 (+132 ms) 2023-07-14 10:13:02,134 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 10:13:02,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 355 msec 2023-07-14 10:13:02,391 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:02,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:13:02,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:13:02,394 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329582394 2023-07-14 10:13:02,395 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36399, tgtDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329582394, rawTgtDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329582394, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:13:02,425 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:13:02,425 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1632985050_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329582394, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329582394/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 10:13:02,425 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-14 10:13:02,460 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329582394/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 10:13:02,496 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:02,497 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:02,497 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:02,498 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:03,546 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-9069061194382797080.jar 2023-07-14 10:13:03,547 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:03,547 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:03,618 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-4455943504042235275.jar 2023-07-14 10:13:03,619 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:03,619 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:03,620 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:03,620 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:03,621 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:03,621 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:03,622 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 10:13:03,622 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 10:13:03,622 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 10:13:03,623 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 10:13:03,623 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 10:13:03,624 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 10:13:03,624 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 10:13:03,624 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 10:13:03,624 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 10:13:03,625 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 10:13:03,626 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:03,626 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:03,627 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:13:03,627 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:03,627 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:03,628 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:13:03,629 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:13:04,664 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0001_000001 (auth:SIMPLE) 2023-07-14 10:13:04,715 WARN [Listener at jenkins-hbase9.apache.org/39497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 10:13:04,720 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-14 10:13:04,724 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 10:13:04,803 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:13:04,803 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:13:05,173 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0002_000001 (auth:SIMPLE) 2023-07-14 10:13:06,101 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 10:13:10,625 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0002_000001 (auth:SIMPLE) 2023-07-14 10:13:12,932 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0002_000001 (auth:SIMPLE) 2023-07-14 10:13:16,474 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0002_000001 (auth:SIMPLE) 2023-07-14 10:13:17,972 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 10:13:17,978 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 10:13:17,989 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-14 10:13:17,989 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 10:13:17,990 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 10:13:17,991 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 10:13:17,991 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 10:13:17,991 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 10:13:17,992 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329582394/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329582394/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 10:13:17,992 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329582394/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 10:13:17,992 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329582394/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 10:13:18,000 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-14 10:13:18,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-07-14 10:13:18,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-14 10:13:18,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 10:13:18,007 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329598007"}]},"ts":"1689329598007"} 2023-07-14 10:13:18,010 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 10:13:18,012 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-14 10:13:18,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=06ca941b9c30e49fee028ab20f34994d, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=818b94bb96b8e7a84e4bedc2368f3d22, UNASSIGN}] 2023-07-14 10:13:18,015 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=818b94bb96b8e7a84e4bedc2368f3d22, UNASSIGN 2023-07-14 10:13:18,016 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=06ca941b9c30e49fee028ab20f34994d, UNASSIGN 2023-07-14 10:13:18,017 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=818b94bb96b8e7a84e4bedc2368f3d22, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:18,017 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689329598017"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329598017"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329598017"}]},"ts":"1689329598017"} 2023-07-14 10:13:18,018 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=06ca941b9c30e49fee028ab20f34994d, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:18,018 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689329598018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329598018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329598018"}]},"ts":"1689329598018"} 2023-07-14 10:13:18,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 818b94bb96b8e7a84e4bedc2368f3d22, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:13:18,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 06ca941b9c30e49fee028ab20f34994d, server=jenkins-hbase9.apache.org,39405,1689329547044}] 2023-07-14 10:13:18,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 10:13:18,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:18,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 818b94bb96b8e7a84e4bedc2368f3d22, disabling compactions & flushes 2023-07-14 10:13:18,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:18,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:18,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. after waiting 0 ms 2023-07-14 10:13:18,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:18,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:18,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 06ca941b9c30e49fee028ab20f34994d, disabling compactions & flushes 2023-07-14 10:13:18,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:18,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:18,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. after waiting 0 ms 2023-07-14 10:13:18,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:18,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:13:18,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:13:18,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:13:18,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d. 2023-07-14 10:13:18,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 06ca941b9c30e49fee028ab20f34994d: 2023-07-14 10:13:18,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:13:18,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22. 2023-07-14 10:13:18,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 818b94bb96b8e7a84e4bedc2368f3d22: 2023-07-14 10:13:18,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:18,197 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=06ca941b9c30e49fee028ab20f34994d, regionState=CLOSED 2023-07-14 10:13:18,197 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689329598197"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329598197"}]},"ts":"1689329598197"} 2023-07-14 10:13:18,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:18,198 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=818b94bb96b8e7a84e4bedc2368f3d22, regionState=CLOSED 2023-07-14 10:13:18,198 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689329598198"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329598198"}]},"ts":"1689329598198"} 2023-07-14 10:13:18,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-14 10:13:18,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 818b94bb96b8e7a84e4bedc2368f3d22, server=jenkins-hbase9.apache.org,35921,1689329546985 in 179 msec 2023-07-14 10:13:18,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-14 10:13:18,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 06ca941b9c30e49fee028ab20f34994d, server=jenkins-hbase9.apache.org,39405,1689329547044 in 177 msec 2023-07-14 10:13:18,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=818b94bb96b8e7a84e4bedc2368f3d22, UNASSIGN in 189 msec 2023-07-14 10:13:18,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-14 10:13:18,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=06ca941b9c30e49fee028ab20f34994d, UNASSIGN in 190 msec 2023-07-14 10:13:18,210 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329598210"}]},"ts":"1689329598210"} 2023-07-14 10:13:18,211 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 10:13:18,213 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-14 10:13:18,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 214 msec 2023-07-14 10:13:18,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 10:13:18,311 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-14 10:13:18,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-07-14 10:13:18,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 10:13:18,316 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 10:13:18,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-14 10:13:18,318 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 10:13:18,319 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-14 10:13:18,323 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:18,323 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:18,323 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:18,324 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:18,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 10:13:18,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 10:13:18,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 10:13:18,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 10:13:18,327 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:18,327 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:18,327 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:18,327 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:18,327 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:18,328 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:18,328 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:18,328 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 10:13:18,328 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:18,328 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:18,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 10:13:18,339 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/recovered.edits] 2023-07-14 10:13:18,340 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/recovered.edits] 2023-07-14 10:13:18,346 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/cf/fe96ae3da90e4cbea2cd1c2479b74fdf to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/cf/fe96ae3da90e4cbea2cd1c2479b74fdf 2023-07-14 10:13:18,347 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/cf/20b662c98c8a409c8adc10477781cd28 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/cf/20b662c98c8a409c8adc10477781cd28 2023-07-14 10:13:18,351 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22/recovered.edits/9.seqid 2023-07-14 10:13:18,351 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/818b94bb96b8e7a84e4bedc2368f3d22 2023-07-14 10:13:18,352 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d/recovered.edits/9.seqid 2023-07-14 10:13:18,352 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemState/06ca941b9c30e49fee028ab20f34994d 2023-07-14 10:13:18,352 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 10:13:18,355 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 10:13:18,360 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-14 10:13:18,366 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-14 10:13:18,368 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 10:13:18,368 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-14 10:13:18,368 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329598368"}]},"ts":"9223372036854775807"} 2023-07-14 10:13:18,368 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329598368"}]},"ts":"9223372036854775807"} 2023-07-14 10:13:18,370 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 10:13:18,370 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 06ca941b9c30e49fee028ab20f34994d, NAME => 'testtb-testExportFileSystemState,,1689329580737.06ca941b9c30e49fee028ab20f34994d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 818b94bb96b8e7a84e4bedc2368f3d22, NAME => 'testtb-testExportFileSystemState,1,1689329580737.818b94bb96b8e7a84e4bedc2368f3d22.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 10:13:18,370 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-14 10:13:18,371 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689329598371"}]},"ts":"9223372036854775807"} 2023-07-14 10:13:18,373 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-14 10:13:18,375 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 10:13:18,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 63 msec 2023-07-14 10:13:18,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 10:13:18,438 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-14 10:13:18,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-14 10:13:18,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-14 10:13:18,461 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-07-14 10:13:18,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-14 10:13:18,501 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=765 (was 751) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:34710 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:42620 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1109605716) connection to jenkins-hbase9.apache.org/172.31.2.10:40973 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1505612623_1 at /127.0.0.1:34696 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1947 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:54528 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1505612623_1 at /127.0.0.1:42600 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 914) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=709 (was 680) - SystemLoadAverage LEAK? -, ProcessCount=193 (was 190) - ProcessCount LEAK? -, AvailableMemoryMB=2013 (was 2853) 2023-07-14 10:13:18,502 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-14 10:13:18,534 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=709, ProcessCount=193, AvailableMemoryMB=2010 2023-07-14 10:13:18,534 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-14 10:13:18,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 10:13:18,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-14 10:13:18,549 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 10:13:18,549 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-14 10:13:18,550 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 10:13:18,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 10:13:18,558 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:13:18,558 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774 2023-07-14 10:13:18,558 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5 empty. 2023-07-14 10:13:18,559 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774 empty. 2023-07-14 10:13:18,559 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:13:18,560 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774 2023-07-14 10:13:18,560 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 10:13:18,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 10:13:18,660 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-14 10:13:18,661 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0eaf89725e00b0255c3eaf923de44cf5, NAME => 'testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:13:18,671 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => a60d7e655465238be9a2cffc208f0774, NAME => 'testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:13:18,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:13:18,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing a60d7e655465238be9a2cffc208f0774, disabling compactions & flushes 2023-07-14 10:13:18,769 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:13:18,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:13:18,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. after waiting 0 ms 2023-07-14 10:13:18,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:13:18,769 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:13:18,769 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for a60d7e655465238be9a2cffc208f0774: 2023-07-14 10:13:18,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 10:13:19,153 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:13:19,154 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 0eaf89725e00b0255c3eaf923de44cf5, disabling compactions & flushes 2023-07-14 10:13:19,154 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:19,154 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:19,154 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. after waiting 0 ms 2023-07-14 10:13:19,154 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:19,154 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:19,154 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 0eaf89725e00b0255c3eaf923de44cf5: 2023-07-14 10:13:19,158 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 10:13:19,160 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689329599159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329599159"}]},"ts":"1689329599159"} 2023-07-14 10:13:19,160 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689329599159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329599159"}]},"ts":"1689329599159"} 2023-07-14 10:13:19,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 10:13:19,176 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 10:13:19,177 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 10:13:19,177 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329599177"}]},"ts":"1689329599177"} 2023-07-14 10:13:19,180 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-14 10:13:19,185 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 10:13:19,188 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 10:13:19,188 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 10:13:19,188 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 10:13:19,189 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 10:13:19,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0eaf89725e00b0255c3eaf923de44cf5, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a60d7e655465238be9a2cffc208f0774, ASSIGN}] 2023-07-14 10:13:19,196 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0eaf89725e00b0255c3eaf923de44cf5, ASSIGN 2023-07-14 10:13:19,196 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a60d7e655465238be9a2cffc208f0774, ASSIGN 2023-07-14 10:13:19,197 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0eaf89725e00b0255c3eaf923de44cf5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35921,1689329546985; forceNewPlan=false, retain=false 2023-07-14 10:13:19,198 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a60d7e655465238be9a2cffc208f0774, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43497,1689329547088; forceNewPlan=false, retain=false 2023-07-14 10:13:19,348 INFO [jenkins-hbase9:39063] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 10:13:19,351 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a60d7e655465238be9a2cffc208f0774, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,351 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689329599351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329599351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329599351"}]},"ts":"1689329599351"} 2023-07-14 10:13:19,352 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0eaf89725e00b0255c3eaf923de44cf5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:19,352 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689329599352"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329599352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329599352"}]},"ts":"1689329599352"} 2023-07-14 10:13:19,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure a60d7e655465238be9a2cffc208f0774, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:13:19,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 0eaf89725e00b0255c3eaf923de44cf5, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:13:19,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:19,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0eaf89725e00b0255c3eaf923de44cf5, NAME => 'testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 10:13:19,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. service=AccessControlService 2023-07-14 10:13:19,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:13:19,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:13:19,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a60d7e655465238be9a2cffc208f0774, NAME => 'testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 10:13:19,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:13:19,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:13:19,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:13:19,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. service=AccessControlService 2023-07-14 10:13:19,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:13:19,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:13:19,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a60d7e655465238be9a2cffc208f0774 2023-07-14 10:13:19,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:13:19,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a60d7e655465238be9a2cffc208f0774 2023-07-14 10:13:19,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a60d7e655465238be9a2cffc208f0774 2023-07-14 10:13:19,538 INFO [StoreOpener-0eaf89725e00b0255c3eaf923de44cf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:13:19,550 INFO [StoreOpener-a60d7e655465238be9a2cffc208f0774-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a60d7e655465238be9a2cffc208f0774 2023-07-14 10:13:19,553 DEBUG [StoreOpener-a60d7e655465238be9a2cffc208f0774-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/cf 2023-07-14 10:13:19,553 DEBUG [StoreOpener-a60d7e655465238be9a2cffc208f0774-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/cf 2023-07-14 10:13:19,554 INFO [StoreOpener-a60d7e655465238be9a2cffc208f0774-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a60d7e655465238be9a2cffc208f0774 columnFamilyName cf 2023-07-14 10:13:19,554 DEBUG [StoreOpener-0eaf89725e00b0255c3eaf923de44cf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/cf 2023-07-14 10:13:19,554 DEBUG [StoreOpener-0eaf89725e00b0255c3eaf923de44cf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/cf 2023-07-14 10:13:19,555 INFO [StoreOpener-0eaf89725e00b0255c3eaf923de44cf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0eaf89725e00b0255c3eaf923de44cf5 columnFamilyName cf 2023-07-14 10:13:19,555 INFO [StoreOpener-a60d7e655465238be9a2cffc208f0774-1] regionserver.HStore(310): Store=a60d7e655465238be9a2cffc208f0774/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:13:19,555 INFO [StoreOpener-0eaf89725e00b0255c3eaf923de44cf5-1] regionserver.HStore(310): Store=0eaf89725e00b0255c3eaf923de44cf5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:13:19,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774 2023-07-14 10:13:19,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774 2023-07-14 10:13:19,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:13:19,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:13:19,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a60d7e655465238be9a2cffc208f0774 2023-07-14 10:13:19,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:13:19,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:13:19,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:13:19,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0eaf89725e00b0255c3eaf923de44cf5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64329753, jitterRate=-0.041411980986595154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:13:19,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0eaf89725e00b0255c3eaf923de44cf5: 2023-07-14 10:13:19,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a60d7e655465238be9a2cffc208f0774; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69113415, jitterRate=0.029870137572288513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:13:19,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a60d7e655465238be9a2cffc208f0774: 2023-07-14 10:13:19,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5., pid=46, masterSystemTime=1689329599509 2023-07-14 10:13:19,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774., pid=45, masterSystemTime=1689329599508 2023-07-14 10:13:19,594 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0eaf89725e00b0255c3eaf923de44cf5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:19,594 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689329599594"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329599594"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329599594"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329599594"}]},"ts":"1689329599594"} 2023-07-14 10:13:19,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:19,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:19,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:13:19,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:13:19,595 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a60d7e655465238be9a2cffc208f0774, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,595 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689329599595"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329599595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329599595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329599595"}]},"ts":"1689329599595"} 2023-07-14 10:13:19,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-14 10:13:19,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 0eaf89725e00b0255c3eaf923de44cf5, server=jenkins-hbase9.apache.org,35921,1689329546985 in 243 msec 2023-07-14 10:13:19,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-14 10:13:19,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure a60d7e655465238be9a2cffc208f0774, server=jenkins-hbase9.apache.org,43497,1689329547088 in 244 msec 2023-07-14 10:13:19,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0eaf89725e00b0255c3eaf923de44cf5, ASSIGN in 412 msec 2023-07-14 10:13:19,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-14 10:13:19,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a60d7e655465238be9a2cffc208f0774, ASSIGN in 413 msec 2023-07-14 10:13:19,610 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 10:13:19,610 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329599610"}]},"ts":"1689329599610"} 2023-07-14 10:13:19,612 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-14 10:13:19,624 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 10:13:19,624 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-14 10:13:19,626 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 10:13:19,628 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:19,628 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:19,629 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:19,629 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:13:19,630 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 10:13:19,630 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 10:13:19,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 10:13:19,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 10:13:19,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 1.0930 sec 2023-07-14 10:13:19,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 10:13:19,669 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-14 10:13:19,669 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-14 10:13:19,670 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:13:19,682 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-14 10:13:19,682 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:13:19,682 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-14 10:13:19,708 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 10:13:19,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329599708 (current time:1689329599708). 2023-07-14 10:13:19,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:13:19,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x33825654 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:13:19,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37759ce0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:13:19,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:13:19,733 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:13:19,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33825654 to 127.0.0.1:60034 2023-07-14 10:13:19,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:13:19,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x16e91f70 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:13:19,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37f8cb0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:13:19,767 DEBUG [hconnection-0x2c71d38c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:13:19,771 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56114, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:13:19,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16e91f70 to 127.0.0.1:60034 2023-07-14 10:13:19,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:13:19,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 10:13:19,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:13:19,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 10:13:19,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 10:13:19,785 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 10:13:19,786 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689330199786 2023-07-14 10:13:19,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 10:13:19,786 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 10:13:19,788 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:13:19,788 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:13:19,792 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 10:13:19,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 10:13:19,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 11 msec 2023-07-14 10:13:19,800 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 10:13:19,801 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689330199801 2023-07-14 10:13:19,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,868 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-14 10:13:19,868 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:19,870 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 10:13:19,870 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 10:13:19,871 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,871 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,873 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:19,873 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:19,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:19,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:19,873 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:19,873 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:19,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:19,874 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:19,874 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,875 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,875 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:13:19,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,875 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 10:13:19,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 10:13:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 10:13:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 10:13:19,876 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 10:13:19,876 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 10:13:19,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,876 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 10:13:19,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,883 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 10:13:19,883 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 10:13:19,883 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:19,883 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 10:13:19,884 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 10:13:19,886 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:19,886 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:19,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:19,887 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,887 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:19,888 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:19,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 10:13:19,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:13:19,890 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:13:19,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:19,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 10:13:19,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d31cd4[Count = 1] remaining members to acquire global barrier 2023-07-14 10:13:19,895 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 10:13:19,895 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 10:13:19,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,895 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 10:13:19,895 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 10:13:19,895 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:19,901 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 10:13:19,901 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 10:13:19,901 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 10:13:19,902 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,902 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:19,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:19,903 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,903 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:19,903 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:19,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:19,904 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,904 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:19,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:19,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:19,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 10:13:19,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d31cd4[Count = 0] remaining members to acquire global barrier 2023-07-14 10:13:19,912 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 10:13:19,912 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,915 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,915 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,915 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,915 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 10:13:19,915 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:19,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,915 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:13:19,915 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:13:19,915 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:13:19,915 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 10:13:19,916 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. started... 2023-07-14 10:13:19,915 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 10:13:19,916 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,916 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:13:19,916 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 10:13:19,916 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:13:19,916 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:13:19,916 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:13:19,918 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a60d7e655465238be9a2cffc208f0774: 2023-07-14 10:13:19,916 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:19,918 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. started... 2023-07-14 10:13:19,918 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,918 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:13:19,918 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:13:19,924 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0eaf89725e00b0255c3eaf923de44cf5: 2023-07-14 10:13:19,924 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,924 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:13:19,924 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:13:19,927 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 10:13:19,927 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:19,927 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 10:13:19,982 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. completed. 2023-07-14 10:13:19,982 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:13:19,982 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:13:19,982 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:13:19,982 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,985 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 10:13:19,993 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:13:19,995 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 10:13:19,995 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:19,995 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 10:13:19,995 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:19,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:19,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:19,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:19,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:20,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:20,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:20,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,43497,1689329547088': 2023-07-14 10:13:20,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 10:13:20,090 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:20,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 10:13:20,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:13:20,093 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:13:20,393 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:20,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 10:13:20,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:13:20,394 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 10:13:20,402 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. completed. 2023-07-14 10:13:20,403 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:20,403 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:13:20,403 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:13:20,403 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:20,403 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 10:13:20,403 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:13:20,406 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 10:13:20,406 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:20,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:20,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:20,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:20,406 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:20,406 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 10:13:20,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:20,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:20,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:20,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:20,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:20,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:20,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:20,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:20,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:20,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,35921,1689329546985': 2023-07-14 10:13:20,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 10:13:20,415 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-14 10:13:20,415 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:13:20,415 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:13:20,415 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,415 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:13:20,418 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,418 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:20,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,418 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,418 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,418 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,418 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:20,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:20,418 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:20,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:20,419 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:20,419 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,420 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:20,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:20,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:20,422 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:20,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:20,422 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,423 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:20,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:20,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:20,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:20,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:20,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:20,435 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:20,435 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,436 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:20,436 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:20,436 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,436 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:20,436 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:20,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:20,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:20,436 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:20,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:20,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:20,436 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:20,436 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:20,436 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,436 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:20,437 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:20,437 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,437 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,439 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:20,439 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:20,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:20,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:20,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:20,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:20,439 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:20,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:20,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:20,439 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:20,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:20,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 10:13:20,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,518 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 10:13:20,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689329599786Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689329600441 (+655 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689329600441Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689329600451 (+10 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689329600475 (+24 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689329600518 (+43 ms) 2023-07-14 10:13:20,521 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 10:13:20,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 733 msec 2023-07-14 10:13:20,895 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:20,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 10:13:20,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:13:20,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35921] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:13:20,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43497] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:13:20,921 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 10:13:20,921 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:20,923 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:13:20,955 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 10:13:20,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329600955 (current time:1689329600955). 2023-07-14 10:13:20,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:13:20,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x55ef9f14 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:13:20,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@510651c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:13:20,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:13:20,984 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:13:20,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55ef9f14 to 127.0.0.1:60034 2023-07-14 10:13:20,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:13:20,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x0929a6ed to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:13:21,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20979fe3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:13:21,007 DEBUG [hconnection-0x43fc7a5f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:13:21,009 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:13:21,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0929a6ed to 127.0.0.1:60034 2023-07-14 10:13:21,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:13:21,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 10:13:21,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:13:21,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 10:13:21,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 10:13:21,020 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 10:13:21,021 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689330201021 2023-07-14 10:13:21,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 10:13:21,021 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 10:13:21,022 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:13:21,022 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:13:21,025 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 10:13:21,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 10:13:21,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-14 10:13:21,027 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 10:13:21,028 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689330201028 2023-07-14 10:13:21,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-14 10:13:21,078 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-14 10:13:21,078 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:21,080 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 10:13:21,080 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 10:13:21,080 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,080 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,082 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:21,082 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:21,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:21,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:21,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:21,082 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:21,082 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:21,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:21,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:21,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,083 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,083 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,084 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,084 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:13:21,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 10:13:21,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,084 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 10:13:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 10:13:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 10:13:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,085 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 10:13:21,085 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 10:13:21,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 10:13:21,086 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 10:13:21,086 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:21,089 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 10:13:21,090 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 10:13:21,090 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:21,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 10:13:21,100 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 10:13:21,100 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 10:13:21,100 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 10:13:21,100 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 10:13:21,100 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 10:13:21,100 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 10:13:21,100 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 10:13:21,100 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:13:21,102 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 10:13:21,102 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 10:13:21,102 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 10:13:21,104 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,104 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,104 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,104 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:21,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:21,104 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,105 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,105 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:21,105 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,105 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:21,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:21,105 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,105 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:13:21,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:21,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 10:13:21,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:21,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 10:13:21,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11601ec5[Count = 1] remaining members to acquire global barrier 2023-07-14 10:13:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:21,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:21,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 10:13:21,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:21,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 10:13:21,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11601ec5[Count = 0] remaining members to acquire global barrier 2023-07-14 10:13:21,115 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 10:13:21,115 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,116 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,116 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,116 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,117 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,117 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 10:13:21,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,117 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 10:13:21,117 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 10:13:21,117 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 10:13:21,117 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:13:21,117 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:13:21,117 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:13:21,117 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:13:21,117 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,117 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:13:21,117 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:13:21,117 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:21,117 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:13:21,118 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. started... 2023-07-14 10:13:21,118 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. started... 2023-07-14 10:13:21,118 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0eaf89725e00b0255c3eaf923de44cf5 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 10:13:21,118 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a60d7e655465238be9a2cffc208f0774 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 10:13:21,120 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 10:13:21,120 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:21,120 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 10:13:21,127 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:21,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 10:13:21,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:13:21,129 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:13:21,162 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/.tmp/cf/f07964ef7a4c4ccb826427dddace6553 2023-07-14 10:13:21,164 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/.tmp/cf/3514d009f7c9417aa3395a4a352530e6 2023-07-14 10:13:21,172 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/.tmp/cf/f07964ef7a4c4ccb826427dddace6553 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/cf/f07964ef7a4c4ccb826427dddace6553 2023-07-14 10:13:21,173 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/.tmp/cf/3514d009f7c9417aa3395a4a352530e6 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/cf/3514d009f7c9417aa3395a4a352530e6 2023-07-14 10:13:21,180 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/cf/f07964ef7a4c4ccb826427dddace6553, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 10:13:21,180 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/cf/3514d009f7c9417aa3395a4a352530e6, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 10:13:21,181 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a60d7e655465238be9a2cffc208f0774 in 63ms, sequenceid=6, compaction requested=false 2023-07-14 10:13:21,181 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-14 10:13:21,182 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 0eaf89725e00b0255c3eaf923de44cf5 in 64ms, sequenceid=6, compaction requested=false 2023-07-14 10:13:21,182 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-14 10:13:21,183 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a60d7e655465238be9a2cffc208f0774: 2023-07-14 10:13:21,183 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0eaf89725e00b0255c3eaf923de44cf5: 2023-07-14 10:13:21,184 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 10:13:21,184 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:13:21,184 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 10:13:21,184 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/cf/f07964ef7a4c4ccb826427dddace6553] hfiles 2023-07-14 10:13:21,184 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:13:21,184 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/cf/f07964ef7a4c4ccb826427dddace6553 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 10:13:21,184 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/cf/3514d009f7c9417aa3395a4a352530e6] hfiles 2023-07-14 10:13:21,184 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/cf/3514d009f7c9417aa3395a4a352530e6 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 10:13:21,218 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. completed. 2023-07-14 10:13:21,218 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:13:21,218 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:13:21,218 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:13:21,218 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,218 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 10:13:21,218 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:13:21,220 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,220 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 10:13:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:21,220 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:21,221 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 10:13:21,226 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. completed. 2023-07-14 10:13:21,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:21,226 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:13:21,226 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:13:21,226 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:13:21,226 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,226 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 10:13:21,226 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:13:21,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:21,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 10:13:21,228 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 10:13:21,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,228 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,229 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:21,229 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 10:13:21,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:21,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 10:13:21,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,35921,1689329546985': 2023-07-14 10:13:21,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 10:13:21,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:21,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 10:13:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 10:13:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,43497,1689329547088': 2023-07-14 10:13:21,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 10:13:21,242 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-14 10:13:21,242 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:13:21,242 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:13:21,242 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-14 10:13:21,242 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:13:21,244 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,244 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,244 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:13:21,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:13:21,244 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,244 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:21,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,244 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:21,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,244 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:21,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:13:21,245 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:21,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:21,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:21,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:21,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:21,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:21,246 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 10:13:21,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,247 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:13:21,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 10:13:21,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:13:21,250 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 10:13:21,250 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,251 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,261 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,261 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:21,261 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,261 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,261 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,261 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,261 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:13:21,261 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,262 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:13:21,262 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:13:21,262 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,262 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,261 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:21,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:21,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:21,261 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:21,261 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:13:21,262 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:21,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:13:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:13:21,262 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:13:21,263 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:13:21,263 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-14 10:13:21,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-14 10:13:21,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:21,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:21,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:21,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:21,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:13:21,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:13:21,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,329 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:21,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 10:13:21,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:13:21,331 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:13:21,389 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 10:13:21,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,389 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689329601022Consolidate snapshot: snaptb0-testConsecutiveExports at 1689329601265 (+243 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689329601265Writing data manifest for snaptb0-testConsecutiveExports at 1689329601270 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689329601305 (+35 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689329601388 (+83 ms) 2023-07-14 10:13:21,393 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 10:13:21,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 370 msec 2023-07-14 10:13:21,631 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:13:21,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 10:13:21,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:13:21,633 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633 2023-07-14 10:13:21,633 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:13:21,661 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:13:21,661 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7a3fbffe, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,661 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 10:13:21,681 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 10:13:21,707 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:21,708 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:21,709 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:21,709 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:22,668 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0002_000001 (auth:SIMPLE) 2023-07-14 10:13:22,724 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-6317831783929935951.jar 2023-07-14 10:13:22,725 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:22,725 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:22,805 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-5204268137682450540.jar 2023-07-14 10:13:22,805 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:22,806 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:22,806 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:22,806 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:22,807 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:22,807 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:22,808 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 10:13:22,808 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 10:13:22,808 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 10:13:22,809 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 10:13:22,809 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 10:13:22,810 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 10:13:22,810 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 10:13:22,810 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 10:13:22,811 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 10:13:22,811 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 10:13:22,812 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:22,812 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:22,813 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:13:22,813 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:22,813 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:22,814 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:13:22,814 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:13:23,401 WARN [Listener at jenkins-hbase9.apache.org/39497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 10:13:23,404 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 10:13:23,407 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 10:13:23,490 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:13:23,491 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:13:23,679 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0003_000001 (auth:SIMPLE) 2023-07-14 10:13:23,807 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 10:13:28,958 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0003_000001 (auth:SIMPLE) 2023-07-14 10:13:31,323 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0003_000001 (auth:SIMPLE) 2023-07-14 10:13:35,550 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0003_000001 (auth:SIMPLE) 2023-07-14 10:13:36,664 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 10:13:36,665 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 10:13:36,670 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 10:13:36,670 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 10:13:36,671 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 10:13:36,671 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 10:13:36,675 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 10:13:36,675 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 10:13:36,675 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6a840a7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 10:13:36,676 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 10:13:36,676 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 10:13:36,677 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:13:36,719 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:13:36,719 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3a404519, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 10:13:36,719 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 10:13:36,739 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 10:13:36,765 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:36,765 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:36,766 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:36,766 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:37,912 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-7514716362603145303.jar 2023-07-14 10:13:37,912 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:37,913 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:38,008 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-6447982534548435336.jar 2023-07-14 10:13:38,008 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:38,009 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:38,010 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:38,010 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:38,011 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:38,011 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 10:13:38,012 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 10:13:38,012 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 10:13:38,013 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 10:13:38,014 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 10:13:38,014 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 10:13:38,015 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 10:13:38,015 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 10:13:38,016 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 10:13:38,016 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 10:13:38,017 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 10:13:38,018 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:38,019 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:38,019 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:13:38,020 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:38,020 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:13:38,021 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:13:38,022 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:13:39,501 WARN [Listener at jenkins-hbase9.apache.org/39497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 10:13:39,508 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 10:13:39,511 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 10:13:41,756 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:13:41,756 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:13:41,778 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0003_000001 (auth:SIMPLE) 2023-07-14 10:13:42,707 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0004_000001 (auth:SIMPLE) 2023-07-14 10:13:51,799 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0004_000001 (auth:SIMPLE) 2023-07-14 10:13:54,203 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0004_000001 (auth:SIMPLE) 2023-07-14 10:14:02,873 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 10:14:02,874 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 10:14:02,895 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 10:14:02,895 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 10:14:02,896 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 10:14:02,896 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 10:14:02,897 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 10:14:02,897 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 10:14:02,897 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6a840a7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 10:14:02,897 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 10:14:02,897 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/local-export-1689329601633/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 10:14:02,912 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-14 10:14:02,913 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-07-14 10:14:02,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-14 10:14:02,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 10:14:02,925 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329642925"}]},"ts":"1689329642925"} 2023-07-14 10:14:02,928 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-14 10:14:02,930 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-14 10:14:02,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0eaf89725e00b0255c3eaf923de44cf5, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a60d7e655465238be9a2cffc208f0774, UNASSIGN}] 2023-07-14 10:14:02,934 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a60d7e655465238be9a2cffc208f0774, UNASSIGN 2023-07-14 10:14:02,936 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0eaf89725e00b0255c3eaf923de44cf5, UNASSIGN 2023-07-14 10:14:02,940 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a60d7e655465238be9a2cffc208f0774, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:02,941 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689329642940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329642940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329642940"}]},"ts":"1689329642940"} 2023-07-14 10:14:02,941 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0eaf89725e00b0255c3eaf923de44cf5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:02,941 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689329642941"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329642941"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329642941"}]},"ts":"1689329642941"} 2023-07-14 10:14:02,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure a60d7e655465238be9a2cffc208f0774, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:14:02,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 0eaf89725e00b0255c3eaf923de44cf5, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:14:03,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 10:14:03,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:14:03,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0eaf89725e00b0255c3eaf923de44cf5, disabling compactions & flushes 2023-07-14 10:14:03,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:14:03,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:14:03,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. after waiting 0 ms 2023-07-14 10:14:03,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:14:03,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a60d7e655465238be9a2cffc208f0774 2023-07-14 10:14:03,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a60d7e655465238be9a2cffc208f0774, disabling compactions & flushes 2023-07-14 10:14:03,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:14:03,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:14:03,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. after waiting 0 ms 2023-07-14 10:14:03,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:14:03,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:14:03,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:14:03,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:14:03,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774. 2023-07-14 10:14:03,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a60d7e655465238be9a2cffc208f0774: 2023-07-14 10:14:03,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a60d7e655465238be9a2cffc208f0774 2023-07-14 10:14:03,130 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a60d7e655465238be9a2cffc208f0774, regionState=CLOSED 2023-07-14 10:14:03,130 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689329643130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329643130"}]},"ts":"1689329643130"} 2023-07-14 10:14:03,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:14:03,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5. 2023-07-14 10:14:03,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0eaf89725e00b0255c3eaf923de44cf5: 2023-07-14 10:14:03,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:14:03,136 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0eaf89725e00b0255c3eaf923de44cf5, regionState=CLOSED 2023-07-14 10:14:03,136 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689329643136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329643136"}]},"ts":"1689329643136"} 2023-07-14 10:14:03,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-14 10:14:03,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure a60d7e655465238be9a2cffc208f0774, server=jenkins-hbase9.apache.org,43497,1689329547088 in 191 msec 2023-07-14 10:14:03,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a60d7e655465238be9a2cffc208f0774, UNASSIGN in 206 msec 2023-07-14 10:14:03,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-14 10:14:03,143 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 0eaf89725e00b0255c3eaf923de44cf5, server=jenkins-hbase9.apache.org,35921,1689329546985 in 196 msec 2023-07-14 10:14:03,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-14 10:14:03,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0eaf89725e00b0255c3eaf923de44cf5, UNASSIGN in 212 msec 2023-07-14 10:14:03,149 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329643149"}]},"ts":"1689329643149"} 2023-07-14 10:14:03,151 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-14 10:14:03,153 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-14 10:14:03,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 250 msec 2023-07-14 10:14:03,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 10:14:03,237 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-14 10:14:03,239 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-07-14 10:14:03,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 10:14:03,244 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 10:14:03,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-14 10:14:03,246 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 10:14:03,249 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-14 10:14:03,254 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 10:14:03,254 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 10:14:03,254 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 10:14:03,254 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 10:14:03,255 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 10:14:03,255 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 10:14:03,255 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 10:14:03,255 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 10:14:03,256 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 10:14:03,256 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:03,256 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 10:14:03,256 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 10:14:03,256 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:03,256 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 10:14:03,256 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:03,256 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:03,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 10:14:03,260 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:14:03,270 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/recovered.edits] 2023-07-14 10:14:03,270 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774 2023-07-14 10:14:03,278 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/recovered.edits] 2023-07-14 10:14:03,286 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/cf/3514d009f7c9417aa3395a4a352530e6 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/cf/3514d009f7c9417aa3395a4a352530e6 2023-07-14 10:14:03,292 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5/recovered.edits/9.seqid 2023-07-14 10:14:03,293 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/0eaf89725e00b0255c3eaf923de44cf5 2023-07-14 10:14:03,294 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/cf/f07964ef7a4c4ccb826427dddace6553 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/cf/f07964ef7a4c4ccb826427dddace6553 2023-07-14 10:14:03,301 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774/recovered.edits/9.seqid 2023-07-14 10:14:03,302 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testConsecutiveExports/a60d7e655465238be9a2cffc208f0774 2023-07-14 10:14:03,302 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 10:14:03,307 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 10:14:03,314 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-14 10:14:03,318 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-14 10:14:03,320 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 10:14:03,321 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-14 10:14:03,321 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329643321"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:03,321 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329643321"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:03,325 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 10:14:03,325 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0eaf89725e00b0255c3eaf923de44cf5, NAME => 'testtb-testConsecutiveExports,,1689329598536.0eaf89725e00b0255c3eaf923de44cf5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a60d7e655465238be9a2cffc208f0774, NAME => 'testtb-testConsecutiveExports,1,1689329598536.a60d7e655465238be9a2cffc208f0774.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 10:14:03,325 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-14 10:14:03,325 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689329643325"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:03,330 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-14 10:14:03,338 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 10:14:03,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 99 msec 2023-07-14 10:14:03,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 10:14:03,359 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-14 10:14:03,372 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-14 10:14:03,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-14 10:14:03,378 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-07-14 10:14:03,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-14 10:14:03,423 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=744 (was 765), OpenFileDescriptor=888 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1086 (was 709) - SystemLoadAverage LEAK? -, ProcessCount=193 (was 193), AvailableMemoryMB=1489 (was 2010) 2023-07-14 10:14:03,423 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-14 10:14:03,465 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=888, MaxFileDescriptor=60000, SystemLoadAverage=1086, ProcessCount=193, AvailableMemoryMB=1490 2023-07-14 10:14:03,465 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-14 10:14:03,467 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 10:14:03,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:03,472 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 10:14:03,473 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-14 10:14:03,474 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 10:14:03,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 10:14:03,477 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:03,480 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe empty. 2023-07-14 10:14:03,480 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:03,481 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:03,481 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48 empty. 2023-07-14 10:14:03,481 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:03,482 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 10:14:03,563 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-14 10:14:03,567 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 26826f38cf31fa2d611470e66e710ebe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:14:03,567 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => df6147ea4dbde5c0ee63d85394ebed48, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:14:03,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 10:14:03,625 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:03,625 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 26826f38cf31fa2d611470e66e710ebe, disabling compactions & flushes 2023-07-14 10:14:03,625 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:03,625 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:03,625 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. after waiting 0 ms 2023-07-14 10:14:03,625 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:03,625 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:03,625 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 26826f38cf31fa2d611470e66e710ebe: 2023-07-14 10:14:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing df6147ea4dbde5c0ee63d85394ebed48, disabling compactions & flushes 2023-07-14 10:14:03,630 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. after waiting 0 ms 2023-07-14 10:14:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:03,630 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:03,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for df6147ea4dbde5c0ee63d85394ebed48: 2023-07-14 10:14:03,635 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 10:14:03,640 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689329643637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329643637"}]},"ts":"1689329643637"} 2023-07-14 10:14:03,640 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689329643637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329643637"}]},"ts":"1689329643637"} 2023-07-14 10:14:03,671 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 10:14:03,673 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 10:14:03,673 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329643673"}]},"ts":"1689329643673"} 2023-07-14 10:14:03,675 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-14 10:14:03,680 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 10:14:03,681 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 10:14:03,681 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 10:14:03,682 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 10:14:03,682 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 10:14:03,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26826f38cf31fa2d611470e66e710ebe, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=df6147ea4dbde5c0ee63d85394ebed48, ASSIGN}] 2023-07-14 10:14:03,690 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=df6147ea4dbde5c0ee63d85394ebed48, ASSIGN 2023-07-14 10:14:03,690 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26826f38cf31fa2d611470e66e710ebe, ASSIGN 2023-07-14 10:14:03,691 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=df6147ea4dbde5c0ee63d85394ebed48, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35921,1689329546985; forceNewPlan=false, retain=false 2023-07-14 10:14:03,692 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26826f38cf31fa2d611470e66e710ebe, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43497,1689329547088; forceNewPlan=false, retain=false 2023-07-14 10:14:03,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 10:14:03,841 INFO [jenkins-hbase9:39063] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 10:14:03,845 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=df6147ea4dbde5c0ee63d85394ebed48, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:03,845 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=26826f38cf31fa2d611470e66e710ebe, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:03,845 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689329643845"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329643845"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329643845"}]},"ts":"1689329643845"} 2023-07-14 10:14:03,845 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689329643845"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329643845"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329643845"}]},"ts":"1689329643845"} 2023-07-14 10:14:03,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure df6147ea4dbde5c0ee63d85394ebed48, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:14:03,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 26826f38cf31fa2d611470e66e710ebe, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:14:04,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:04,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => df6147ea4dbde5c0ee63d85394ebed48, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 10:14:04,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. service=AccessControlService 2023-07-14 10:14:04,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:14:04,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:04,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:04,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:04,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:04,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:04,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 26826f38cf31fa2d611470e66e710ebe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 10:14:04,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. service=AccessControlService 2023-07-14 10:14:04,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:14:04,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:04,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:04,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:04,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:04,015 INFO [StoreOpener-df6147ea4dbde5c0ee63d85394ebed48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:04,019 INFO [StoreOpener-26826f38cf31fa2d611470e66e710ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:04,023 DEBUG [StoreOpener-26826f38cf31fa2d611470e66e710ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/cf 2023-07-14 10:14:04,023 DEBUG [StoreOpener-26826f38cf31fa2d611470e66e710ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/cf 2023-07-14 10:14:04,029 DEBUG [StoreOpener-df6147ea4dbde5c0ee63d85394ebed48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/cf 2023-07-14 10:14:04,029 DEBUG [StoreOpener-df6147ea4dbde5c0ee63d85394ebed48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/cf 2023-07-14 10:14:04,029 INFO [StoreOpener-df6147ea4dbde5c0ee63d85394ebed48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df6147ea4dbde5c0ee63d85394ebed48 columnFamilyName cf 2023-07-14 10:14:04,029 INFO [StoreOpener-26826f38cf31fa2d611470e66e710ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26826f38cf31fa2d611470e66e710ebe columnFamilyName cf 2023-07-14 10:14:04,031 INFO [StoreOpener-26826f38cf31fa2d611470e66e710ebe-1] regionserver.HStore(310): Store=26826f38cf31fa2d611470e66e710ebe/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:14:04,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:04,032 INFO [StoreOpener-df6147ea4dbde5c0ee63d85394ebed48-1] regionserver.HStore(310): Store=df6147ea4dbde5c0ee63d85394ebed48/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:14:04,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:04,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:04,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:04,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:04,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:04,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:14:04,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 26826f38cf31fa2d611470e66e710ebe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67830959, jitterRate=0.010760053992271423}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:14:04,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 26826f38cf31fa2d611470e66e710ebe: 2023-07-14 10:14:04,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe., pid=61, masterSystemTime=1689329644003 2023-07-14 10:14:04,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:04,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:04,062 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=26826f38cf31fa2d611470e66e710ebe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,062 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689329644062"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329644062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329644062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329644062"}]},"ts":"1689329644062"} 2023-07-14 10:14:04,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:14:04,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened df6147ea4dbde5c0ee63d85394ebed48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61644969, jitterRate=-0.08141838014125824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:14:04,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for df6147ea4dbde5c0ee63d85394ebed48: 2023-07-14 10:14:04,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48., pid=60, masterSystemTime=1689329644002 2023-07-14 10:14:04,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-14 10:14:04,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 26826f38cf31fa2d611470e66e710ebe, server=jenkins-hbase9.apache.org,43497,1689329547088 in 216 msec 2023-07-14 10:14:04,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:04,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:04,070 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=df6147ea4dbde5c0ee63d85394ebed48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,071 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689329644070"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329644070"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329644070"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329644070"}]},"ts":"1689329644070"} 2023-07-14 10:14:04,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26826f38cf31fa2d611470e66e710ebe, ASSIGN in 386 msec 2023-07-14 10:14:04,075 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-14 10:14:04,075 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure df6147ea4dbde5c0ee63d85394ebed48, server=jenkins-hbase9.apache.org,35921,1689329546985 in 224 msec 2023-07-14 10:14:04,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-14 10:14:04,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=df6147ea4dbde5c0ee63d85394ebed48, ASSIGN in 393 msec 2023-07-14 10:14:04,078 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 10:14:04,078 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329644078"}]},"ts":"1689329644078"} 2023-07-14 10:14:04,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 10:14:04,089 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-14 10:14:04,096 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 10:14:04,097 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-14 10:14:04,102 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 10:14:04,105 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:04,105 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:04,105 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:04,105 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:04,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:04,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:04,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:04,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:04,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 644 msec 2023-07-14 10:14:04,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 10:14:04,583 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-14 10:14:04,583 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-14 10:14:04,584 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:14:04,587 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-14 10:14:04,588 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:14:04,588 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-14 10:14:04,591 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 10:14:04,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329644591 (current time:1689329644591). 2023-07-14 10:14:04,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:14:04,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x4ae7014c to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:04,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26e7c8a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:04,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:04,622 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:04,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ae7014c to 127.0.0.1:60034 2023-07-14 10:14:04,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:04,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x6658080b to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:04,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14c798ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:04,675 DEBUG [hconnection-0xc7dd02b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:04,680 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:04,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6658080b to 127.0.0.1:60034 2023-07-14 10:14:04,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:04,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 10:14:04,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:14:04,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 10:14:04,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 10:14:04,703 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 10:14:04,705 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689330244705 2023-07-14 10:14:04,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 10:14:04,706 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,707 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:14:04,708 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:14:04,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 10:14:04,713 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 10:14:04,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 13 msec 2023-07-14 10:14:04,719 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 10:14:04,720 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689330244720 2023-07-14 10:14:04,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,794 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 10:14:04,794 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:04,795 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 10:14:04,795 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 10:14:04,796 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,796 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,797 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:04,797 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:04,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:04,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:04,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:04,797 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,797 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:04,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,798 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,798 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,799 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,799 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:14:04,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 10:14:04,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,799 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 10:14:04,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 10:14:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 10:14:04,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,801 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 10:14:04,801 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 10:14:04,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,802 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 10:14:04,802 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:04,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,807 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 10:14:04,807 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 10:14:04,807 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:04,807 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 10:14:04,807 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 10:14:04,808 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:04,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 10:14:04,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:04,809 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,809 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:14:04,809 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,809 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:04,815 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,815 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 10:14:04,815 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 10:14:04,815 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:04,815 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 10:14:04,815 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 10:14:04,816 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 10:14:04,816 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 10:14:04,816 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 10:14:04,820 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,820 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:04,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:04,820 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:04,820 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,821 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:04,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:04,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:04,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 10:14:04,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17b58d7d[Count = 1] remaining members to acquire global barrier 2023-07-14 10:14:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:04,825 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,825 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,825 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:04,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 10:14:04,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17b58d7d[Count = 0] remaining members to acquire global barrier 2023-07-14 10:14:04,827 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 10:14:04,827 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,828 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,828 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,829 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,830 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 10:14:04,830 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,830 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 10:14:04,830 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 10:14:04,830 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 10:14:04,830 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:14:04,830 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,830 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:14:04,835 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:04,835 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:04,835 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:04,835 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. started... 2023-07-14 10:14:04,837 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 26826f38cf31fa2d611470e66e710ebe: 2023-07-14 10:14:04,838 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,838 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:04,838 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:04,838 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:04,838 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:04,838 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. started... 2023-07-14 10:14:04,838 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:14:04,840 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for df6147ea4dbde5c0ee63d85394ebed48: 2023-07-14 10:14:04,842 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 10:14:04,842 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:04,842 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 10:14:04,845 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,845 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:04,845 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:14:04,906 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. completed. 2023-07-14 10:14:04,906 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:04,906 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:04,906 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:04,906 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,906 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 10:14:04,906 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:14:04,910 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,910 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 10:14:04,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:04,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:04,910 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:04,911 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 10:14:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,918 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. completed. 2023-07-14 10:14:04,918 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:04,918 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:04,918 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:04,918 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,918 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 10:14:04,918 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:14:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,920 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 10:14:04,920 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:04,920 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 10:14:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,923 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,43497,1689329547088': 2023-07-14 10:14:04,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 10:14:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:04,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:04,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,35921,1689329546985': 2023-07-14 10:14:04,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 10:14:04,941 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 10:14:04,941 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:14:04,942 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:14:04,942 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,942 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:14:04,945 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,945 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,945 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,945 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:04,945 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:04,945 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,945 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:04,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:04,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:04,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:04,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:04,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:04,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,948 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,949 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:04,950 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,953 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:04,953 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,955 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,961 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:04,961 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:04,961 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:04,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:04,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:04,961 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:04,962 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:04,962 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:04,962 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,962 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,962 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:04,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:04,962 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:04,963 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:04,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:04,963 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,965 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,965 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:04,965 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,965 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:04,965 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:04,965 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,965 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:04,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:04,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:04,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:04,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:05,009 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:05,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 10:14:05,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:05,012 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:14:05,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,155 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 10:14:05,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,157 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689329644706Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689329644962 (+256 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689329644963 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689329644978 (+15 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689329645033 (+55 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689329645155 (+122 ms) 2023-07-14 10:14:05,161 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 10:14:05,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 454 msec 2023-07-14 10:14:05,312 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:05,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 10:14:05,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:14:05,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43497] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:14:05,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35921] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:14:05,331 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,331 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:05,331 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:14:05,363 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 10:14:05,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329645363 (current time:1689329645363). 2023-07-14 10:14:05,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:14:05,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x065b2ace to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:05,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@730e443f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:05,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:05,388 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:05,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x065b2ace to 127.0.0.1:60034 2023-07-14 10:14:05,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:05,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x1c05dde4 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:05,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43d799f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:05,450 DEBUG [hconnection-0x42f90209-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:05,454 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:05,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c05dde4 to 127.0.0.1:60034 2023-07-14 10:14:05,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:05,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 10:14:05,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:14:05,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 10:14:05,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 10:14:05,469 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 10:14:05,470 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689330245470 2023-07-14 10:14:05,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 10:14:05,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,472 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:14:05,472 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:14:05,474 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 10:14:05,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 10:14:05,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-14 10:14:05,479 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 10:14:05,480 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689330245480 2023-07-14 10:14:05,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,530 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 10:14:05,530 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:05,532 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 10:14:05,532 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 10:14:05,533 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,533 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,535 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:05,535 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:05,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:05,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,536 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,536 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,536 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:05,536 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:05,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:05,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:05,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,537 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,537 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:14:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 10:14:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,541 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 10:14:05,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:05,541 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:05,542 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 10:14:05,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,542 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:05,543 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 10:14:05,543 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 10:14:05,544 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 10:14:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 10:14:05,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,544 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 10:14:05,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,544 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 10:14:05,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:05,547 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,547 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:05,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:05,548 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,548 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:05,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:05,549 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 10:14:05,549 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 10:14:05,549 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 10:14:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 10:14:05,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,550 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 10:14:05,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 10:14:05,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5875b00e[Count = 1] remaining members to acquire global barrier 2023-07-14 10:14:05,551 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,552 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,552 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,552 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:05,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:05,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,554 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 10:14:05,554 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,556 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 10:14:05,556 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 10:14:05,556 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 10:14:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:05,558 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,559 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,560 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:05,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 10:14:05,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5875b00e[Count = 0] remaining members to acquire global barrier 2023-07-14 10:14:05,560 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 10:14:05,560 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,563 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,564 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,564 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 10:14:05,564 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 10:14:05,565 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:05,565 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:05,567 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:05,567 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. started... 2023-07-14 10:14:05,568 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,569 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 10:14:05,569 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 10:14:05,569 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:14:05,570 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,571 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 26826f38cf31fa2d611470e66e710ebe 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-14 10:14:05,572 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:05,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 10:14:05,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:05,573 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:14:05,574 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:05,574 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:05,577 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:05,578 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. started... 2023-07-14 10:14:05,578 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 10:14:05,578 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:05,578 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 10:14:05,578 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,578 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:14:05,578 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2745): Flushing df6147ea4dbde5c0ee63d85394ebed48 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-14 10:14:05,633 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/.tmp/cf/08b54d56f05143309fa11c4d4e1f6c1f 2023-07-14 10:14:05,641 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/.tmp/cf/08b54d56f05143309fa11c4d4e1f6c1f as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/cf/08b54d56f05143309fa11c4d4e1f6c1f 2023-07-14 10:14:05,646 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/.tmp/cf/bec2c8d64374411b927134056948b523 2023-07-14 10:14:05,647 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/cf/08b54d56f05143309fa11c4d4e1f6c1f, entries=4, sequenceid=6, filesize=5.1 K 2023-07-14 10:14:05,649 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 26826f38cf31fa2d611470e66e710ebe in 78ms, sequenceid=6, compaction requested=false 2023-07-14 10:14:05,649 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-14 10:14:05,650 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 26826f38cf31fa2d611470e66e710ebe: 2023-07-14 10:14:05,650 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,650 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:05,650 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/cf/08b54d56f05143309fa11c4d4e1f6c1f] hfiles 2023-07-14 10:14:05,650 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/cf/08b54d56f05143309fa11c4d4e1f6c1f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,654 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/.tmp/cf/bec2c8d64374411b927134056948b523 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/cf/bec2c8d64374411b927134056948b523 2023-07-14 10:14:05,668 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/cf/bec2c8d64374411b927134056948b523, entries=46, sequenceid=6, filesize=7.9 K 2023-07-14 10:14:05,670 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for df6147ea4dbde5c0ee63d85394ebed48 in 92ms, sequenceid=6, compaction requested=false 2023-07-14 10:14:05,682 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for df6147ea4dbde5c0ee63d85394ebed48: 2023-07-14 10:14:05,682 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,682 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:05,682 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/cf/bec2c8d64374411b927134056948b523] hfiles 2023-07-14 10:14:05,682 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/cf/bec2c8d64374411b927134056948b523 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,770 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. completed. 2023-07-14 10:14:05,770 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:05,770 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:05,770 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:05,770 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,773 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 10:14:05,773 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:14:05,774 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:05,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 10:14:05,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:05,775 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,775 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:14:05,775 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 10:14:05,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:05,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:05,775 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:05,776 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 10:14:05,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:05,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:05,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:05,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:05,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,43497,1689329547088': 2023-07-14 10:14:05,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 10:14:05,826 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. completed. 2023-07-14 10:14:05,826 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:05,826 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:05,826 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:05,826 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,826 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 10:14:05,826 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:14:05,829 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 10:14:05,829 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:05,829 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 10:14:05,829 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:05,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:05,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:05,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:05,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:05,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,35921,1689329546985': 2023-07-14 10:14:05,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 10:14:05,842 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 10:14:05,842 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:14:05,842 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:14:05,842 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,842 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:14:05,848 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,848 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:05,848 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,849 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:05,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,848 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,849 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:05,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,848 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:05,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:05,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:05,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:05,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:05,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:05,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,850 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:05,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:05,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:05,852 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,853 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:05,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:05,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:05,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:05,856 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,857 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,857 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:05,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:05,863 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:05,863 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,863 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:05,863 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:05,863 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,863 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:05,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:05,863 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:05,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:05,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,863 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:05,871 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:05,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:05,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:05,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:05,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:05,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:05,871 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:05,871 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:05,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:05,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:05,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:05,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:05,863 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,872 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:05,873 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,873 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:05,873 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:05,873 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:05,873 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:06,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:06,075 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:06,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 10:14:06,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:06,078 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 10:14:06,144 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 10:14:06,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:06,145 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:06,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689329645471Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689329645871 (+400 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689329645871Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689329645914 (+43 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689329645987 (+73 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689329646144 (+157 ms) 2023-07-14 10:14:06,149 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 10:14:06,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 677 msec 2023-07-14 10:14:06,579 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:06,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 10:14:06,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:14:06,635 DEBUG [Listener at jenkins-hbase9.apache.org/39497] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 10:14:06,653 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 10:14:06,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35921] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 10:14:06,664 DEBUG [Listener at jenkins-hbase9.apache.org/39497] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 10:14:06,673 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 10:14:06,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39405] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 10:14:06,675 DEBUG [Listener at jenkins-hbase9.apache.org/39497] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 10:14:06,688 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:60454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 10:14:06,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43497] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 10:14:06,691 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 10:14:06,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:06,700 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 10:14:06,705 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-14 10:14:06,705 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 10:14:06,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 10:14:06,718 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:06,719 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:06,720 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea empty. 2023-07-14 10:14:06,734 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:06,741 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2 empty. 2023-07-14 10:14:06,742 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:06,742 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 10:14:06,785 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-14 10:14:06,787 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => e15ecdd857bc0255f28d5121894280ea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:14:06,788 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9f0c7e10549438ce48c3c9b5a367e4d2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:14:06,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 10:14:06,843 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:06,843 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing e15ecdd857bc0255f28d5121894280ea, disabling compactions & flushes 2023-07-14 10:14:06,843 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. 2023-07-14 10:14:06,843 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. 2023-07-14 10:14:06,843 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. after waiting 0 ms 2023-07-14 10:14:06,843 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. 2023-07-14 10:14:06,844 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. 2023-07-14 10:14:06,844 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for e15ecdd857bc0255f28d5121894280ea: 2023-07-14 10:14:06,850 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:06,850 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 9f0c7e10549438ce48c3c9b5a367e4d2, disabling compactions & flushes 2023-07-14 10:14:06,850 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. 2023-07-14 10:14:06,850 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. 2023-07-14 10:14:06,850 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. after waiting 0 ms 2023-07-14 10:14:06,850 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. 2023-07-14 10:14:06,850 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. 2023-07-14 10:14:06,850 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 9f0c7e10549438ce48c3c9b5a367e4d2: 2023-07-14 10:14:06,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 10:14:06,859 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689329646858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329646858"}]},"ts":"1689329646858"} 2023-07-14 10:14:06,859 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689329646858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329646858"}]},"ts":"1689329646858"} 2023-07-14 10:14:06,872 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 10:14:06,873 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 10:14:06,874 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329646873"}]},"ts":"1689329646873"} 2023-07-14 10:14:06,875 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-14 10:14:06,880 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 10:14:06,882 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 10:14:06,882 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 10:14:06,882 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 10:14:06,882 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 10:14:06,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e15ecdd857bc0255f28d5121894280ea, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0c7e10549438ce48c3c9b5a367e4d2, ASSIGN}] 2023-07-14 10:14:06,886 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0c7e10549438ce48c3c9b5a367e4d2, ASSIGN 2023-07-14 10:14:06,886 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e15ecdd857bc0255f28d5121894280ea, ASSIGN 2023-07-14 10:14:06,893 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0c7e10549438ce48c3c9b5a367e4d2, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35921,1689329546985; forceNewPlan=false, retain=false 2023-07-14 10:14:06,894 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e15ecdd857bc0255f28d5121894280ea, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43497,1689329547088; forceNewPlan=false, retain=false 2023-07-14 10:14:07,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 10:14:07,043 INFO [jenkins-hbase9:39063] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 10:14:07,046 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e15ecdd857bc0255f28d5121894280ea, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:07,047 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689329647046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329647046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329647046"}]},"ts":"1689329647046"} 2023-07-14 10:14:07,047 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9f0c7e10549438ce48c3c9b5a367e4d2, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:07,048 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689329647047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329647047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329647047"}]},"ts":"1689329647047"} 2023-07-14 10:14:07,050 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure e15ecdd857bc0255f28d5121894280ea, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:14:07,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 9f0c7e10549438ce48c3c9b5a367e4d2, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:14:07,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. 2023-07-14 10:14:07,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f0c7e10549438ce48c3c9b5a367e4d2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2.', STARTKEY => '2', ENDKEY => ''} 2023-07-14 10:14:07,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. service=AccessControlService 2023-07-14 10:14:07,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:14:07,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:07,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:07,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:07,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:07,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. 2023-07-14 10:14:07,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e15ecdd857bc0255f28d5121894280ea, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea.', STARTKEY => '', ENDKEY => '2'} 2023-07-14 10:14:07,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. service=AccessControlService 2023-07-14 10:14:07,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:14:07,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:07,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:07,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:07,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:07,234 INFO [StoreOpener-9f0c7e10549438ce48c3c9b5a367e4d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:07,247 DEBUG [StoreOpener-9f0c7e10549438ce48c3c9b5a367e4d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/cf 2023-07-14 10:14:07,247 DEBUG [StoreOpener-9f0c7e10549438ce48c3c9b5a367e4d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/cf 2023-07-14 10:14:07,248 INFO [StoreOpener-9f0c7e10549438ce48c3c9b5a367e4d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f0c7e10549438ce48c3c9b5a367e4d2 columnFamilyName cf 2023-07-14 10:14:07,248 INFO [StoreOpener-9f0c7e10549438ce48c3c9b5a367e4d2-1] regionserver.HStore(310): Store=9f0c7e10549438ce48c3c9b5a367e4d2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:14:07,250 INFO [StoreOpener-e15ecdd857bc0255f28d5121894280ea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:07,254 DEBUG [StoreOpener-e15ecdd857bc0255f28d5121894280ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/cf 2023-07-14 10:14:07,254 DEBUG [StoreOpener-e15ecdd857bc0255f28d5121894280ea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/cf 2023-07-14 10:14:07,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:07,254 INFO [StoreOpener-e15ecdd857bc0255f28d5121894280ea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e15ecdd857bc0255f28d5121894280ea columnFamilyName cf 2023-07-14 10:14:07,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:07,255 INFO [StoreOpener-e15ecdd857bc0255f28d5121894280ea-1] regionserver.HStore(310): Store=e15ecdd857bc0255f28d5121894280ea/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:14:07,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:07,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:07,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:07,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:14:07,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 9f0c7e10549438ce48c3c9b5a367e4d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63910971, jitterRate=-0.04765231907367706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:14:07,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 9f0c7e10549438ce48c3c9b5a367e4d2: 2023-07-14 10:14:07,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:07,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2., pid=70, masterSystemTime=1689329647205 2023-07-14 10:14:07,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. 2023-07-14 10:14:07,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. 2023-07-14 10:14:07,270 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9f0c7e10549438ce48c3c9b5a367e4d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:07,270 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689329647270"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329647270"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329647270"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329647270"}]},"ts":"1689329647270"} 2023-07-14 10:14:07,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-14 10:14:07,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 9f0c7e10549438ce48c3c9b5a367e4d2, server=jenkins-hbase9.apache.org,35921,1689329546985 in 223 msec 2023-07-14 10:14:07,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0c7e10549438ce48c3c9b5a367e4d2, ASSIGN in 395 msec 2023-07-14 10:14:07,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:14:07,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e15ecdd857bc0255f28d5121894280ea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66790380, jitterRate=-0.004745781421661377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:14:07,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e15ecdd857bc0255f28d5121894280ea: 2023-07-14 10:14:07,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea., pid=69, masterSystemTime=1689329647205 2023-07-14 10:14:07,296 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e15ecdd857bc0255f28d5121894280ea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:07,296 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689329647296"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329647296"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329647296"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329647296"}]},"ts":"1689329647296"} 2023-07-14 10:14:07,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. 2023-07-14 10:14:07,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. 2023-07-14 10:14:07,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-14 10:14:07,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure e15ecdd857bc0255f28d5121894280ea, server=jenkins-hbase9.apache.org,43497,1689329547088 in 249 msec 2023-07-14 10:14:07,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-14 10:14:07,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e15ecdd857bc0255f28d5121894280ea, ASSIGN in 424 msec 2023-07-14 10:14:07,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 10:14:07,314 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 10:14:07,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329647314"}]},"ts":"1689329647314"} 2023-07-14 10:14:07,316 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-14 10:14:07,319 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 10:14:07,319 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-14 10:14:07,321 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 10:14:07,322 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:07,322 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:07,323 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:07,323 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:07,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:07,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:07,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:07,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:07,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:07,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:07,326 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:07,326 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:07,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 634 msec 2023-07-14 10:14:07,541 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0004_000001 (auth:SIMPLE) 2023-07-14 10:14:07,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 10:14:07,822 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-14 10:14:07,887 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions e15ecdd857bc0255f28d5121894280ea, 9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:07,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e15ecdd857bc0255f28d5121894280ea, 9f0c7e10549438ce48c3c9b5a367e4d2], force=true 2023-07-14 10:14:07,905 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e15ecdd857bc0255f28d5121894280ea, 9f0c7e10549438ce48c3c9b5a367e4d2], force=true 2023-07-14 10:14:07,906 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e15ecdd857bc0255f28d5121894280ea, 9f0c7e10549438ce48c3c9b5a367e4d2], force=true 2023-07-14 10:14:07,906 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e15ecdd857bc0255f28d5121894280ea, 9f0c7e10549438ce48c3c9b5a367e4d2], force=true 2023-07-14 10:14:07,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 10:14:07,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e15ecdd857bc0255f28d5121894280ea, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0c7e10549438ce48c3c9b5a367e4d2, UNASSIGN}] 2023-07-14 10:14:07,951 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0c7e10549438ce48c3c9b5a367e4d2, UNASSIGN 2023-07-14 10:14:07,953 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e15ecdd857bc0255f28d5121894280ea, UNASSIGN 2023-07-14 10:14:07,956 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9f0c7e10549438ce48c3c9b5a367e4d2, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:07,956 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689329647956"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329647956"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329647956"}]},"ts":"1689329647956"} 2023-07-14 10:14:07,957 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e15ecdd857bc0255f28d5121894280ea, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:07,957 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689329647957"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329647957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329647957"}]},"ts":"1689329647957"} 2023-07-14 10:14:07,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure e15ecdd857bc0255f28d5121894280ea, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:14:07,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 9f0c7e10549438ce48c3c9b5a367e4d2, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:14:08,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 10:14:08,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:08,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e15ecdd857bc0255f28d5121894280ea, disabling compactions & flushes 2023-07-14 10:14:08,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. 2023-07-14 10:14:08,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. 2023-07-14 10:14:08,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. after waiting 0 ms 2023-07-14 10:14:08,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. 2023-07-14 10:14:08,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing e15ecdd857bc0255f28d5121894280ea 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 10:14:08,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:08,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 9f0c7e10549438ce48c3c9b5a367e4d2, disabling compactions & flushes 2023-07-14 10:14:08,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. 2023-07-14 10:14:08,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. 2023-07-14 10:14:08,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. after waiting 0 ms 2023-07-14 10:14:08,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. 2023-07-14 10:14:08,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 9f0c7e10549438ce48c3c9b5a367e4d2 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 10:14:08,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 10:14:08,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/.tmp/cf/8408a048717943b89f626485f88d46e2 2023-07-14 10:14:08,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/.tmp/cf/e5e6323ed0ec483f8faa4bc0c68444f0 2023-07-14 10:14:08,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/.tmp/cf/8408a048717943b89f626485f88d46e2 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/cf/8408a048717943b89f626485f88d46e2 2023-07-14 10:14:08,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/.tmp/cf/e5e6323ed0ec483f8faa4bc0c68444f0 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/cf/e5e6323ed0ec483f8faa4bc0c68444f0 2023-07-14 10:14:08,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/cf/e5e6323ed0ec483f8faa4bc0c68444f0, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 10:14:08,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 9f0c7e10549438ce48c3c9b5a367e4d2 in 133ms, sequenceid=5, compaction requested=false 2023-07-14 10:14:08,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 10:14:08,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/cf/8408a048717943b89f626485f88d46e2, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 10:14:08,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e15ecdd857bc0255f28d5121894280ea in 170ms, sequenceid=5, compaction requested=false 2023-07-14 10:14:08,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 10:14:08,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:14:08,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2. 2023-07-14 10:14:08,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 9f0c7e10549438ce48c3c9b5a367e4d2: 2023-07-14 10:14:08,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:08,339 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9f0c7e10549438ce48c3c9b5a367e4d2, regionState=CLOSED 2023-07-14 10:14:08,339 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689329648339"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329648339"}]},"ts":"1689329648339"} 2023-07-14 10:14:08,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-14 10:14:08,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 9f0c7e10549438ce48c3c9b5a367e4d2, server=jenkins-hbase9.apache.org,35921,1689329546985 in 378 msec 2023-07-14 10:14:08,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0c7e10549438ce48c3c9b5a367e4d2, UNASSIGN in 396 msec 2023-07-14 10:14:08,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 10:14:08,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:14:08,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea. 2023-07-14 10:14:08,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e15ecdd857bc0255f28d5121894280ea: 2023-07-14 10:14:08,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:08,371 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e15ecdd857bc0255f28d5121894280ea, regionState=CLOSED 2023-07-14 10:14:08,372 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689329648371"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329648371"}]},"ts":"1689329648371"} 2023-07-14 10:14:08,376 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-14 10:14:08,376 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure e15ecdd857bc0255f28d5121894280ea, server=jenkins-hbase9.apache.org,43497,1689329547088 in 411 msec 2023-07-14 10:14:08,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-14 10:14:08,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e15ecdd857bc0255f28d5121894280ea, UNASSIGN in 434 msec 2023-07-14 10:14:08,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 10:14:08,666 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-14 10:14:08,673 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646691.e15ecdd857bc0255f28d5121894280ea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:08,673 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689329646691.9f0c7e10549438ce48c3c9b5a367e4d2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:08,673 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:08,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b630f9d66c257c3a9e33fade5d82019b, ASSIGN}] 2023-07-14 10:14:08,773 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b630f9d66c257c3a9e33fade5d82019b, ASSIGN 2023-07-14 10:14:08,775 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b630f9d66c257c3a9e33fade5d82019b, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,43497,1689329547088; forceNewPlan=false, retain=false 2023-07-14 10:14:08,860 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 10:14:08,925 INFO [jenkins-hbase9:39063] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 10:14:08,927 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b630f9d66c257c3a9e33fade5d82019b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:08,927 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689329648927"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329648927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329648927"}]},"ts":"1689329648927"} 2023-07-14 10:14:08,940 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure b630f9d66c257c3a9e33fade5d82019b, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:14:09,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 10:14:09,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. 2023-07-14 10:14:09,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b630f9d66c257c3a9e33fade5d82019b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b.', STARTKEY => '', ENDKEY => ''} 2023-07-14 10:14:09,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. service=AccessControlService 2023-07-14 10:14:09,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:14:09,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b630f9d66c257c3a9e33fade5d82019b 2023-07-14 10:14:09,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:09,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b630f9d66c257c3a9e33fade5d82019b 2023-07-14 10:14:09,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b630f9d66c257c3a9e33fade5d82019b 2023-07-14 10:14:09,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/.regioninfo 2023-07-14 10:14:09,203 INFO [StoreOpener-b630f9d66c257c3a9e33fade5d82019b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b630f9d66c257c3a9e33fade5d82019b 2023-07-14 10:14:09,216 DEBUG [StoreOpener-b630f9d66c257c3a9e33fade5d82019b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf 2023-07-14 10:14:09,217 DEBUG [StoreOpener-b630f9d66c257c3a9e33fade5d82019b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf 2023-07-14 10:14:09,217 INFO [StoreOpener-b630f9d66c257c3a9e33fade5d82019b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b630f9d66c257c3a9e33fade5d82019b columnFamilyName cf 2023-07-14 10:14:09,337 DEBUG [StoreOpener-b630f9d66c257c3a9e33fade5d82019b-1] regionserver.HStore(539): loaded hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf/8408a048717943b89f626485f88d46e2.e15ecdd857bc0255f28d5121894280ea->hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/cf/8408a048717943b89f626485f88d46e2-top 2023-07-14 10:14:09,347 DEBUG [StoreOpener-b630f9d66c257c3a9e33fade5d82019b-1] regionserver.HStore(539): loaded hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf/e5e6323ed0ec483f8faa4bc0c68444f0.9f0c7e10549438ce48c3c9b5a367e4d2->hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/cf/e5e6323ed0ec483f8faa4bc0c68444f0-top 2023-07-14 10:14:09,348 INFO [StoreOpener-b630f9d66c257c3a9e33fade5d82019b-1] regionserver.HStore(310): Store=b630f9d66c257c3a9e33fade5d82019b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:14:09,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b 2023-07-14 10:14:09,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b 2023-07-14 10:14:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b630f9d66c257c3a9e33fade5d82019b 2023-07-14 10:14:09,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b630f9d66c257c3a9e33fade5d82019b; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65527937, jitterRate=-0.023557648062705994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:14:09,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b630f9d66c257c3a9e33fade5d82019b: 2023-07-14 10:14:09,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b., pid=77, masterSystemTime=1689329649098 2023-07-14 10:14:09,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b.,because compaction is disabled. 2023-07-14 10:14:09,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. 2023-07-14 10:14:09,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. 2023-07-14 10:14:09,362 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b630f9d66c257c3a9e33fade5d82019b, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:09,362 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689329649362"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329649362"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329649362"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329649362"}]},"ts":"1689329649362"} 2023-07-14 10:14:09,367 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-14 10:14:09,367 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure b630f9d66c257c3a9e33fade5d82019b, server=jenkins-hbase9.apache.org,43497,1689329547088 in 424 msec 2023-07-14 10:14:09,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-14 10:14:09,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b630f9d66c257c3a9e33fade5d82019b, ASSIGN in 595 msec 2023-07-14 10:14:09,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e15ecdd857bc0255f28d5121894280ea, 9f0c7e10549438ce48c3c9b5a367e4d2], force=true in 1.4780 sec 2023-07-14 10:14:10,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 10:14:10,026 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-14 10:14:10,027 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 10:14:10,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329650027 (current time:1689329650027). 2023-07-14 10:14:10,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:14:10,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x0818a2cc to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:10,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14662468, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:10,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:10,075 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:10,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0818a2cc to 127.0.0.1:60034 2023-07-14 10:14:10,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:10,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x4dd2db2d to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:10,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@111e99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:10,088 DEBUG [hconnection-0x25f12f97-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:10,091 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:10,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dd2db2d to 127.0.0.1:60034 2023-07-14 10:14:10,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:10,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 10:14:10,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:14:10,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 10:14:10,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 10:14:10,113 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 10:14:10,115 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689330250115 2023-07-14 10:14:10,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 10:14:10,115 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,121 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:14:10,121 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:14:10,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 10:14:10,133 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 10:14:10,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 33 msec 2023-07-14 10:14:10,136 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 10:14:10,137 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689330250137 2023-07-14 10:14:10,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,169 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 10:14:10,169 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:10,170 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-14 10:14:10,170 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-14 10:14:10,203 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,203 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,205 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:10,205 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:10,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:10,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:10,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:10,205 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:10,205 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:10,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:10,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:10,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,213 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,213 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:14:10,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 10:14:10,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 10:14:10,214 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 10:14:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 10:14:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,214 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 10:14:10,214 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 10:14:10,214 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:10,214 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 10:14:10,221 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:10,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 10:14:10,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:10,223 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:14:10,235 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 10:14:10,235 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 10:14:10,235 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 10:14:10,236 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,236 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 10:14:10,236 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,236 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:10,236 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 10:14:10,236 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:10,249 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 10:14:10,250 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 10:14:10,250 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 10:14:10,249 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 10:14:10,250 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 10:14:10,250 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 10:14:10,251 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,251 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,251 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:10,255 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,256 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,256 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,256 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,256 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:10,257 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,257 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:10,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:10,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:10,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:10,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:10,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-14 10:14:10,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41d93268[Count = 0] remaining members to acquire global barrier 2023-07-14 10:14:10,260 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-14 10:14:10,260 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,262 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,262 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 10:14:10,265 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,265 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 10:14:10,265 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 10:14:10,265 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:14:10,266 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:10,266 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:10,266 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. 2023-07-14 10:14:10,266 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. started... 2023-07-14 10:14:10,268 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,268 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 10:14:10,268 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 10:14:10,268 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:14:10,268 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,269 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:14:10,270 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 10:14:10,270 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:10,270 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 10:14:10,279 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 10:14:10,279 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:10,279 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 10:14:10,284 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b630f9d66c257c3a9e33fade5d82019b: 2023-07-14 10:14:10,284 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,284 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:10,284 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf/8408a048717943b89f626485f88d46e2.e15ecdd857bc0255f28d5121894280ea->hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/cf/8408a048717943b89f626485f88d46e2-top, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf/e5e6323ed0ec483f8faa4bc0c68444f0.9f0c7e10549438ce48c3c9b5a367e4d2->hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/cf/e5e6323ed0ec483f8faa4bc0c68444f0-top] hfiles 2023-07-14 10:14:10,285 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf/8408a048717943b89f626485f88d46e2.e15ecdd857bc0255f28d5121894280ea for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,286 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf/e5e6323ed0ec483f8faa4bc0c68444f0.9f0c7e10549438ce48c3c9b5a367e4d2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,368 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. completed. 2023-07-14 10:14:10,369 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. 2023-07-14 10:14:10,369 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:10,369 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:10,369 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,369 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 10:14:10,369 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:14:10,374 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,374 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 10:14:10,374 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:10,374 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 10:14:10,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:10,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:10,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:10,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,43497,1689329547088': 2023-07-14 10:14:10,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-14 10:14:10,380 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-14 10:14:10,380 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:14:10,380 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:14:10,380 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,380 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:14:10,382 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,382 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:10,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,382 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,382 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,382 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,383 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:10,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:10,383 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:10,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:10,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:10,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:10,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:10,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:10,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:10,384 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:10,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:10,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,385 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,385 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:10,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:10,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:10,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:10,388 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:10,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:10,388 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,389 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:10,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:10,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:10,393 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:10,393 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,393 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:10,393 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,393 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,394 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:10,394 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,394 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:10,394 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,394 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:10,394 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:10,394 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,394 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,394 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:10,394 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:10,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:10,395 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:10,395 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:10,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:10,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:10,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:10,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:10,395 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:10,396 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:10,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:10,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:10,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:10,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:10,423 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:10,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 10:14:10,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:10,424 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:14:10,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-14 10:14:10,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,640 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689329650115Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689329650393 (+278 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689329650393Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689329650413 (+20 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689329650490 (+77 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689329650640 (+150 ms) 2023-07-14 10:14:10,644 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 10:14:10,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 523 msec 2023-07-14 10:14:10,725 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:10,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 10:14:10,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:14:10,726 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329650726 2023-07-14 10:14:10,727 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36399, tgtDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329650726, rawTgtDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329650726, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:14:10,755 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:14:10,755 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-927026557_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329650726, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329650726/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,755 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-14 10:14:10,763 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329650726/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:10,984 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:10,985 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:10,985 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:10,986 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:12,403 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-8618385769530320689.jar 2023-07-14 10:14:12,403 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:12,404 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:12,515 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-1038333428904469125.jar 2023-07-14 10:14:12,516 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:12,516 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:12,517 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:12,517 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:12,518 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:12,518 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:12,519 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 10:14:12,520 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 10:14:12,521 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 10:14:12,521 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 10:14:12,522 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 10:14:12,523 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 10:14:12,523 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 10:14:12,523 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 10:14:12,524 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 10:14:12,525 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 10:14:12,526 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:12,526 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:12,527 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:14:12,528 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:12,528 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:12,530 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:14:12,531 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:14:13,834 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 10:14:14,342 WARN [Listener at jenkins-hbase9.apache.org/39497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 10:14:14,347 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-14 10:14:14,351 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-14 10:14:14,501 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:14:14,503 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:14:14,535 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0005_000001 (auth:SIMPLE) 2023-07-14 10:14:23,299 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0005_000001 (auth:SIMPLE) 2023-07-14 10:14:25,779 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0005_000001 (auth:SIMPLE) 2023-07-14 10:14:31,932 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0005_000001 (auth:SIMPLE) 2023-07-14 10:14:33,769 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 10:14:33,771 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 10:14:33,811 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:33,811 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 10:14:33,812 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 10:14:33,812 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:33,813 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 10:14:33,813 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 10:14:33,813 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329650726/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329650726/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:33,814 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329650726/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 10:14:33,814 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329650726/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 10:14:33,830 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:33,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:33,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:33,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 10:14:33,841 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329673841"}]},"ts":"1689329673841"} 2023-07-14 10:14:33,843 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-14 10:14:33,846 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-14 10:14:33,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b630f9d66c257c3a9e33fade5d82019b, UNASSIGN}] 2023-07-14 10:14:33,855 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b630f9d66c257c3a9e33fade5d82019b, UNASSIGN 2023-07-14 10:14:33,856 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b630f9d66c257c3a9e33fade5d82019b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:33,857 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689329673856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329673856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329673856"}]},"ts":"1689329673856"} 2023-07-14 10:14:33,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure b630f9d66c257c3a9e33fade5d82019b, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:14:33,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 10:14:34,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close b630f9d66c257c3a9e33fade5d82019b 2023-07-14 10:14:34,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b630f9d66c257c3a9e33fade5d82019b, disabling compactions & flushes 2023-07-14 10:14:34,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. 2023-07-14 10:14:34,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. 2023-07-14 10:14:34,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. after waiting 0 ms 2023-07-14 10:14:34,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. 2023-07-14 10:14:34,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-14 10:14:34,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:14:34,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b. 2023-07-14 10:14:34,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b630f9d66c257c3a9e33fade5d82019b: 2023-07-14 10:14:34,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed b630f9d66c257c3a9e33fade5d82019b 2023-07-14 10:14:34,047 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b630f9d66c257c3a9e33fade5d82019b, regionState=CLOSED 2023-07-14 10:14:34,047 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689329674047"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329674047"}]},"ts":"1689329674047"} 2023-07-14 10:14:34,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-14 10:14:34,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure b630f9d66c257c3a9e33fade5d82019b, server=jenkins-hbase9.apache.org,43497,1689329547088 in 188 msec 2023-07-14 10:14:34,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-14 10:14:34,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b630f9d66c257c3a9e33fade5d82019b, UNASSIGN in 204 msec 2023-07-14 10:14:34,074 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329674074"}]},"ts":"1689329674074"} 2023-07-14 10:14:34,081 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-14 10:14:34,086 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-14 10:14:34,092 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 258 msec 2023-07-14 10:14:34,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 10:14:34,147 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-14 10:14:34,149 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,153 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,154 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,159 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,160 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b 2023-07-14 10:14:34,161 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:34,161 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:34,163 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,164 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 10:14:34,164 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,164 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,164 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,170 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/recovered.edits] 2023-07-14 10:14:34,171 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:34,171 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 10:14:34,171 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 10:14:34,171 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:34,171 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 10:14:34,171 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 10:14:34,171 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,171 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:34,171 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:34,171 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 10:14:34,171 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 10:14:34,172 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:34,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:34,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:34,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:34,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 10:14:34,174 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/recovered.edits] 2023-07-14 10:14:34,175 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/recovered.edits] 2023-07-14 10:14:34,184 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf/8408a048717943b89f626485f88d46e2.e15ecdd857bc0255f28d5121894280ea to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf/8408a048717943b89f626485f88d46e2.e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:34,185 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/cf/8408a048717943b89f626485f88d46e2 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/cf/8408a048717943b89f626485f88d46e2 2023-07-14 10:14:34,185 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/cf/e5e6323ed0ec483f8faa4bc0c68444f0 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/cf/e5e6323ed0ec483f8faa4bc0c68444f0 2023-07-14 10:14:34,192 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf/e5e6323ed0ec483f8faa4bc0c68444f0.9f0c7e10549438ce48c3c9b5a367e4d2 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/cf/e5e6323ed0ec483f8faa4bc0c68444f0.9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:34,200 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/recovered.edits/12.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b/recovered.edits/12.seqid 2023-07-14 10:14:34,202 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/recovered.edits/8.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea/recovered.edits/8.seqid 2023-07-14 10:14:34,203 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b630f9d66c257c3a9e33fade5d82019b 2023-07-14 10:14:34,203 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e15ecdd857bc0255f28d5121894280ea 2023-07-14 10:14:34,204 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/recovered.edits/8.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2/recovered.edits/8.seqid 2023-07-14 10:14:34,205 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0c7e10549438ce48c3c9b5a367e4d2 2023-07-14 10:14:34,205 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 10:14:34,208 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,225 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-14 10:14:34,229 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-14 10:14:34,230 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,230 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-14 10:14:34,230 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329674230"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:34,249 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-14 10:14:34,249 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b630f9d66c257c3a9e33fade5d82019b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689329646692.b630f9d66c257c3a9e33fade5d82019b.', STARTKEY => '', ENDKEY => ''}] 2023-07-14 10:14:34,249 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-14 10:14:34,249 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689329674249"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:34,252 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-14 10:14:34,273 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 124 msec 2023-07-14 10:14:34,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 10:14:34,279 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-14 10:14:34,279 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 10:14:34,286 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329674285"}]},"ts":"1689329674285"} 2023-07-14 10:14:34,287 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-14 10:14:34,289 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-14 10:14:34,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26826f38cf31fa2d611470e66e710ebe, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=df6147ea4dbde5c0ee63d85394ebed48, UNASSIGN}] 2023-07-14 10:14:34,291 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=df6147ea4dbde5c0ee63d85394ebed48, UNASSIGN 2023-07-14 10:14:34,293 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26826f38cf31fa2d611470e66e710ebe, UNASSIGN 2023-07-14 10:14:34,295 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=df6147ea4dbde5c0ee63d85394ebed48, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:34,295 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=26826f38cf31fa2d611470e66e710ebe, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:34,295 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689329674295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329674295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329674295"}]},"ts":"1689329674295"} 2023-07-14 10:14:34,296 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689329674295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329674295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329674295"}]},"ts":"1689329674295"} 2023-07-14 10:14:34,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 26826f38cf31fa2d611470e66e710ebe, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:14:34,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure df6147ea4dbde5c0ee63d85394ebed48, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:14:34,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 10:14:34,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:34,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 26826f38cf31fa2d611470e66e710ebe, disabling compactions & flushes 2023-07-14 10:14:34,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:34,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:34,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. after waiting 1 ms 2023-07-14 10:14:34,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:34,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:34,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing df6147ea4dbde5c0ee63d85394ebed48, disabling compactions & flushes 2023-07-14 10:14:34,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:34,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:34,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. after waiting 0 ms 2023-07-14 10:14:34,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:34,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:14:34,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:14:34,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48. 2023-07-14 10:14:34,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for df6147ea4dbde5c0ee63d85394ebed48: 2023-07-14 10:14:34,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:14:34,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:14:34,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe. 2023-07-14 10:14:34,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 26826f38cf31fa2d611470e66e710ebe: 2023-07-14 10:14:34,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:34,526 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=df6147ea4dbde5c0ee63d85394ebed48, regionState=CLOSED 2023-07-14 10:14:34,526 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689329674526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329674526"}]},"ts":"1689329674526"} 2023-07-14 10:14:34,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:34,527 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=26826f38cf31fa2d611470e66e710ebe, regionState=CLOSED 2023-07-14 10:14:34,528 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689329674527"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329674527"}]},"ts":"1689329674527"} 2023-07-14 10:14:34,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-14 10:14:34,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-14 10:14:34,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 26826f38cf31fa2d611470e66e710ebe, server=jenkins-hbase9.apache.org,43497,1689329547088 in 236 msec 2023-07-14 10:14:34,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure df6147ea4dbde5c0ee63d85394ebed48, server=jenkins-hbase9.apache.org,35921,1689329546985 in 230 msec 2023-07-14 10:14:34,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=26826f38cf31fa2d611470e66e710ebe, UNASSIGN in 247 msec 2023-07-14 10:14:34,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-14 10:14:34,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=df6147ea4dbde5c0ee63d85394ebed48, UNASSIGN in 247 msec 2023-07-14 10:14:34,553 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329674553"}]},"ts":"1689329674553"} 2023-07-14 10:14:34,560 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-14 10:14:34,562 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-14 10:14:34,566 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 283 msec 2023-07-14 10:14:34,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 10:14:34,592 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-14 10:14:34,593 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,597 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,599 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,601 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,604 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,604 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,605 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,605 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,606 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 10:14:34,606 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 10:14:34,606 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 10:14:34,606 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 10:14:34,607 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,607 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:34,607 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,608 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:34,608 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,608 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:34,608 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,608 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:34,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 10:14:34,616 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:34,626 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/recovered.edits] 2023-07-14 10:14:34,629 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:34,638 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/cf/08b54d56f05143309fa11c4d4e1f6c1f to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/cf/08b54d56f05143309fa11c4d4e1f6c1f 2023-07-14 10:14:34,639 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/recovered.edits] 2023-07-14 10:14:34,649 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/cf/bec2c8d64374411b927134056948b523 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/cf/bec2c8d64374411b927134056948b523 2023-07-14 10:14:34,653 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48/recovered.edits/9.seqid 2023-07-14 10:14:34,654 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/df6147ea4dbde5c0ee63d85394ebed48 2023-07-14 10:14:34,657 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe/recovered.edits/9.seqid 2023-07-14 10:14:34,657 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/26826f38cf31fa2d611470e66e710ebe 2023-07-14 10:14:34,658 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 10:14:34,666 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,671 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-14 10:14:34,685 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-14 10:14:34,686 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,686 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-14 10:14:34,687 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329674687"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:34,687 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329674687"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:34,689 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 10:14:34,689 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 26826f38cf31fa2d611470e66e710ebe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689329643467.26826f38cf31fa2d611470e66e710ebe.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => df6147ea4dbde5c0ee63d85394ebed48, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689329643467.df6147ea4dbde5c0ee63d85394ebed48.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 10:14:34,689 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-14 10:14:34,689 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689329674689"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:34,695 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-14 10:14:34,698 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,699 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 105 msec 2023-07-14 10:14:34,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 10:14:34,710 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-14 10:14:34,732 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 10:14:34,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 10:14:34,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 10:14:34,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-14 10:14:34,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 10:14:34,810 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 744) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:42396 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:42070 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540040478_1 at /127.0.0.1:42052 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1109605716) connection to jenkins-hbase9.apache.org/172.31.2.10:41885 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3830 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:49210 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1540040478_1 at /127.0.0.1:42370 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=900 (was 888) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1217 (was 1086) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 193), AvailableMemoryMB=507 (was 1490) 2023-07-14 10:14:34,810 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-14 10:14:34,864 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=1217, ProcessCount=192, AvailableMemoryMB=504 2023-07-14 10:14:34,864 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-14 10:14:34,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 10:14:34,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 10:14:34,872 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 10:14:34,873 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 10:14:34,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-14 10:14:34,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 10:14:34,876 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:34,876 DEBUG [HFileArchiver-24] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:34,877 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1 empty. 2023-07-14 10:14:34,877 DEBUG [HFileArchiver-24] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98 empty. 2023-07-14 10:14:34,877 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:34,878 DEBUG [HFileArchiver-24] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:34,878 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 10:14:34,953 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 10:14:34,970 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => cc52d3b6c8c30175a1c9159f1038fa98, NAME => 'testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:14:34,974 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8a470ddeb9173a9da6b5f97bd73ae2f1, NAME => 'testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:14:34,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 10:14:35,120 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:35,120 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8a470ddeb9173a9da6b5f97bd73ae2f1, disabling compactions & flushes 2023-07-14 10:14:35,120 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:35,120 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:35,121 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. after waiting 0 ms 2023-07-14 10:14:35,121 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:35,121 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:35,121 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8a470ddeb9173a9da6b5f97bd73ae2f1: 2023-07-14 10:14:35,135 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:35,135 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing cc52d3b6c8c30175a1c9159f1038fa98, disabling compactions & flushes 2023-07-14 10:14:35,135 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:35,135 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:35,135 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. after waiting 0 ms 2023-07-14 10:14:35,135 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:35,136 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:35,136 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for cc52d3b6c8c30175a1c9159f1038fa98: 2023-07-14 10:14:35,147 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 10:14:35,148 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689329675148"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329675148"}]},"ts":"1689329675148"} 2023-07-14 10:14:35,149 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689329675148"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329675148"}]},"ts":"1689329675148"} 2023-07-14 10:14:35,156 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 10:14:35,159 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 10:14:35,159 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329675159"}]},"ts":"1689329675159"} 2023-07-14 10:14:35,164 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 10:14:35,170 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 10:14:35,173 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 10:14:35,173 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 10:14:35,173 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 10:14:35,173 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 10:14:35,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc52d3b6c8c30175a1c9159f1038fa98, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a470ddeb9173a9da6b5f97bd73ae2f1, ASSIGN}] 2023-07-14 10:14:35,177 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a470ddeb9173a9da6b5f97bd73ae2f1, ASSIGN 2023-07-14 10:14:35,178 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc52d3b6c8c30175a1c9159f1038fa98, ASSIGN 2023-07-14 10:14:35,179 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a470ddeb9173a9da6b5f97bd73ae2f1, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39405,1689329547044; forceNewPlan=false, retain=false 2023-07-14 10:14:35,179 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc52d3b6c8c30175a1c9159f1038fa98, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,43497,1689329547088; forceNewPlan=false, retain=false 2023-07-14 10:14:35,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 10:14:35,329 INFO [jenkins-hbase9:39063] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 10:14:35,333 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=cc52d3b6c8c30175a1c9159f1038fa98, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:35,333 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689329675333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329675333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329675333"}]},"ts":"1689329675333"} 2023-07-14 10:14:35,333 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8a470ddeb9173a9da6b5f97bd73ae2f1, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:35,334 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689329675333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329675333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329675333"}]},"ts":"1689329675333"} 2023-07-14 10:14:35,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 8a470ddeb9173a9da6b5f97bd73ae2f1, server=jenkins-hbase9.apache.org,39405,1689329547044}] 2023-07-14 10:14:35,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure cc52d3b6c8c30175a1c9159f1038fa98, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:14:35,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 10:14:35,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:35,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a470ddeb9173a9da6b5f97bd73ae2f1, NAME => 'testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 10:14:35,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. service=AccessControlService 2023-07-14 10:14:35,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:14:35,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:35,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:35,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:35,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:35,512 INFO [StoreOpener-8a470ddeb9173a9da6b5f97bd73ae2f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:35,515 DEBUG [StoreOpener-8a470ddeb9173a9da6b5f97bd73ae2f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/cf 2023-07-14 10:14:35,515 DEBUG [StoreOpener-8a470ddeb9173a9da6b5f97bd73ae2f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/cf 2023-07-14 10:14:35,516 INFO [StoreOpener-8a470ddeb9173a9da6b5f97bd73ae2f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a470ddeb9173a9da6b5f97bd73ae2f1 columnFamilyName cf 2023-07-14 10:14:35,517 INFO [StoreOpener-8a470ddeb9173a9da6b5f97bd73ae2f1-1] regionserver.HStore(310): Store=8a470ddeb9173a9da6b5f97bd73ae2f1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:14:35,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:35,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc52d3b6c8c30175a1c9159f1038fa98, NAME => 'testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 10:14:35,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. service=AccessControlService 2023-07-14 10:14:35,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:14:35,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:35,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:35,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:35,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:35,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:35,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:35,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:35,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:14:35,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8a470ddeb9173a9da6b5f97bd73ae2f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68637892, jitterRate=0.022784292697906494}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:14:35,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8a470ddeb9173a9da6b5f97bd73ae2f1: 2023-07-14 10:14:35,534 INFO [StoreOpener-cc52d3b6c8c30175a1c9159f1038fa98-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:35,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1., pid=93, masterSystemTime=1689329675488 2023-07-14 10:14:35,537 DEBUG [StoreOpener-cc52d3b6c8c30175a1c9159f1038fa98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/cf 2023-07-14 10:14:35,537 DEBUG [StoreOpener-cc52d3b6c8c30175a1c9159f1038fa98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/cf 2023-07-14 10:14:35,538 INFO [StoreOpener-cc52d3b6c8c30175a1c9159f1038fa98-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc52d3b6c8c30175a1c9159f1038fa98 columnFamilyName cf 2023-07-14 10:14:35,539 INFO [StoreOpener-cc52d3b6c8c30175a1c9159f1038fa98-1] regionserver.HStore(310): Store=cc52d3b6c8c30175a1c9159f1038fa98/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:14:35,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:35,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:35,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:35,540 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8a470ddeb9173a9da6b5f97bd73ae2f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:35,540 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689329675540"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329675540"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329675540"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329675540"}]},"ts":"1689329675540"} 2023-07-14 10:14:35,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:35,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:35,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-14 10:14:35,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 8a470ddeb9173a9da6b5f97bd73ae2f1, server=jenkins-hbase9.apache.org,39405,1689329547044 in 206 msec 2023-07-14 10:14:35,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a470ddeb9173a9da6b5f97bd73ae2f1, ASSIGN in 375 msec 2023-07-14 10:14:35,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:14:35,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened cc52d3b6c8c30175a1c9159f1038fa98; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59665389, jitterRate=-0.11091642081737518}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:14:35,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for cc52d3b6c8c30175a1c9159f1038fa98: 2023-07-14 10:14:35,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98., pid=94, masterSystemTime=1689329675505 2023-07-14 10:14:35,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:35,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:35,570 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=cc52d3b6c8c30175a1c9159f1038fa98, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:35,570 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689329675570"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329675570"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329675570"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329675570"}]},"ts":"1689329675570"} 2023-07-14 10:14:35,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-14 10:14:35,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure cc52d3b6c8c30175a1c9159f1038fa98, server=jenkins-hbase9.apache.org,43497,1689329547088 in 234 msec 2023-07-14 10:14:35,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-14 10:14:35,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc52d3b6c8c30175a1c9159f1038fa98, ASSIGN in 402 msec 2023-07-14 10:14:35,582 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 10:14:35,582 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329675582"}]},"ts":"1689329675582"} 2023-07-14 10:14:35,584 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 10:14:35,589 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 10:14:35,589 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-14 10:14:35,591 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 10:14:35,593 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:35,593 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:35,593 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:35,593 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:35,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:35,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:35,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:35,596 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:35,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 728 msec 2023-07-14 10:14:35,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 10:14:35,986 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-14 10:14:35,986 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-14 10:14:35,986 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:14:36,007 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-14 10:14:36,007 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:14:36,007 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-14 10:14:36,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:14:36,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329676037 (current time:1689329676037). 2023-07-14 10:14:36,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:14:36,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x6324266e to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:36,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8d419b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:36,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:36,088 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:36,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6324266e to 127.0.0.1:60034 2023-07-14 10:14:36,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:36,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x77231a53 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:36,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3576458f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:36,126 DEBUG [hconnection-0x1d47c31a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:36,128 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:36,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77231a53 to 127.0.0.1:60034 2023-07-14 10:14:36,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:36,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 10:14:36,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:14:36,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:14:36,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:14:36,148 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:14:36,149 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689330276149 2023-07-14 10:14:36,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:14:36,150 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 10:14:36,150 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:14:36,151 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:14:36,156 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:14:36,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 10:14:36,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-14 10:14:36,162 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 10:14:36,166 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689330276166 2023-07-14 10:14:36,242 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-14 10:14:36,251 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:36,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:14:36,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:36,252 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:14:36,264 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,264 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-14 10:14:36,264 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:36,264 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 10:14:36,264 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 10:14:36,264 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,264 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:36,276 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:36,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:36,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:36,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:36,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:36,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:36,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:36,276 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,276 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:36,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 10:14:36,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,278 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 10:14:36,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,278 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,279 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:14:36,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 10:14:36,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,279 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 10:14:36,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 10:14:36,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,280 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 10:14:36,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,286 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 10:14:36,286 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:36,286 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,286 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 10:14:36,286 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:36,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,296 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 10:14:36,296 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 10:14:36,296 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 10:14:36,296 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 10:14:36,296 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 10:14:36,296 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:36,296 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 10:14:36,296 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 10:14:36,298 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 10:14:36,298 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 10:14:36,298 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 10:14:36,300 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,301 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,301 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,301 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,301 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:36,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:36,302 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,302 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:36,301 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:36,302 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,302 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,302 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:36,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:36,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:36,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 10:14:36,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@505e8aa0[Count = 1] remaining members to acquire global barrier 2023-07-14 10:14:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:36,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:36,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:36,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:36,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:36,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 10:14:36,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@505e8aa0[Count = 0] remaining members to acquire global barrier 2023-07-14 10:14:36,324 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 10:14:36,324 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,326 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,326 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:14:36,327 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,327 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,327 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:14:36,327 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:14:36,327 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 10:14:36,327 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:14:36,334 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,336 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,336 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:14:36,336 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 10:14:36,336 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:36,336 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 10:14:36,338 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:36,349 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:36,350 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:36,350 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:36,350 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:36,350 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. started... 2023-07-14 10:14:36,359 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a470ddeb9173a9da6b5f97bd73ae2f1: 2023-07-14 10:14:36,359 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:36,359 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,360 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:36,360 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:14:36,359 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. started... 2023-07-14 10:14:36,362 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc52d3b6c8c30175a1c9159f1038fa98: 2023-07-14 10:14:36,362 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,362 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:36,363 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:14:36,414 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. completed. 2023-07-14 10:14:36,414 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:36,414 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:36,414 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:36,414 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,414 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 10:14:36,414 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:14:36,415 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. completed. 2023-07-14 10:14:36,415 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:36,415 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:36,416 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:36,416 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,416 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 10:14:36,416 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:14:36,416 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 10:14:36,416 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:36,416 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 10:14:36,417 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:36,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:36,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:36,418 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 10:14:36,418 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,418 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:36,418 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 10:14:36,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:36,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:36,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,39405,1689329547044': 2023-07-14 10:14:36,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 10:14:36,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:36,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:36,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:36,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:36,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:36,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,43497,1689329547088': 2023-07-14 10:14:36,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 10:14:36,438 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 10:14:36,438 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:14:36,438 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:14:36,438 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,438 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:14:36,440 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,440 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,441 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:36,441 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:36,441 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:36,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:36,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,441 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,441 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:36,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:36,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:36,442 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:36,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:36,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:36,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:36,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:36,442 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,443 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:36,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:36,446 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,446 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,446 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,451 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:36,451 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:36,451 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:36,451 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:36,452 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:36,452 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:36,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:36,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:36,452 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:36,454 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:36,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:36,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:36,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:14:36,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:36,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:36,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:36,451 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:36,456 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:14:36,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:36,451 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,457 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,457 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,457 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,457 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:36,457 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,457 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:36,457 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:36,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:36,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:36,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,457 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,457 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:36,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:36,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,713 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 10:14:36,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,714 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:36,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689329676150Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689329676457 (+307 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689329676457Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689329676479 (+22 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689329676533 (+54 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689329676713 (+180 ms) 2023-07-14 10:14:36,719 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 10:14:36,720 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 565 msec 2023-07-14 10:14:36,757 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:36,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:14:36,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:14:36,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43497] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:14:36,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39405] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:14:36,798 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 10:14:36,798 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:36,798 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:14:36,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:14:36,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329676856 (current time:1689329676856). 2023-07-14 10:14:36,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:14:36,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x4f0a065c to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:36,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cf653b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:36,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:36,945 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:36,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f0a065c to 127.0.0.1:60034 2023-07-14 10:14:36,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:36,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x704d4ed0 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:37,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fea9e63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:37,045 DEBUG [hconnection-0x315f1bd9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:37,050 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:37,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x704d4ed0 to 127.0.0.1:60034 2023-07-14 10:14:37,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:37,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 10:14:37,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:14:37,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:14:37,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:14:37,064 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:14:37,065 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689330277065 2023-07-14 10:14:37,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 10:14:37,066 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 10:14:37,068 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:14:37,069 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:14:37,069 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 10:14:37,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 10:14:37,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-14 10:14:37,073 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 10:14:37,073 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689330277073 2023-07-14 10:14:37,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,150 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-14 10:14:37,150 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:37,155 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 10:14:37,155 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 10:14:37,156 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,156 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,169 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:37,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:14:37,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:37,171 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:14:37,200 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:37,200 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:37,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:37,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:37,201 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:37,201 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:37,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:37,201 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:37,201 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,202 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:37,202 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:14:37,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 10:14:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 10:14:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 10:14:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 10:14:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 10:14:37,203 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 10:14:37,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,210 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 10:14:37,210 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:37,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,219 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 10:14:37,219 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:37,219 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 10:14:37,219 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 10:14:37,219 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 10:14:37,221 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 10:14:37,221 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 10:14:37,221 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 10:14:37,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,230 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 10:14:37,230 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:37,235 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 10:14:37,235 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 10:14:37,235 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 10:14:37,285 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,354 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:37,354 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:37,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:37,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:37,354 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,355 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:37,371 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:37,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:14:37,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:37,373 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:14:37,416 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:37,416 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:37,417 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,417 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:37,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:37,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:37,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:37,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:37,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:37,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 10:14:37,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b3b2bb3[Count = 1] remaining members to acquire global barrier 2023-07-14 10:14:37,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:37,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:37,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:37,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:37,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:37,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:37,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:37,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:37,422 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,422 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:37,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:37,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 10:14:37,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b3b2bb3[Count = 0] remaining members to acquire global barrier 2023-07-14 10:14:37,428 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 10:14:37,428 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,473 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,474 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,474 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,474 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:14:37,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,474 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:14:37,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,474 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 10:14:37,474 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 10:14:37,474 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:14:37,474 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:37,475 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:37,475 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:14:37,479 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 10:14:37,479 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:37,479 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 10:14:37,498 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:37,498 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:37,516 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:37,516 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:37,516 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. started... 2023-07-14 10:14:37,590 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:37,590 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. started... 2023-07-14 10:14:37,590 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a470ddeb9173a9da6b5f97bd73ae2f1 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 10:14:37,590 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc52d3b6c8c30175a1c9159f1038fa98 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 10:14:37,516 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:37,673 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:37,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:14:37,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:37,675 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 10:14:37,775 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/.tmp/cf/55031dfc02514af2a6697a8f747cbaf9 2023-07-14 10:14:37,790 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/.tmp/cf/55031dfc02514af2a6697a8f747cbaf9 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/cf/55031dfc02514af2a6697a8f747cbaf9 2023-07-14 10:14:37,794 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/.tmp/cf/332ce5bae1644e07947c0636d6634acc 2023-07-14 10:14:37,806 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/cf/55031dfc02514af2a6697a8f747cbaf9, entries=47, sequenceid=6, filesize=8 K 2023-07-14 10:14:37,807 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 8a470ddeb9173a9da6b5f97bd73ae2f1 in 217ms, sequenceid=6, compaction requested=false 2023-07-14 10:14:37,816 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a470ddeb9173a9da6b5f97bd73ae2f1: 2023-07-14 10:14:37,817 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,817 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:37,817 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/cf/55031dfc02514af2a6697a8f747cbaf9] hfiles 2023-07-14 10:14:37,817 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/cf/55031dfc02514af2a6697a8f747cbaf9 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,824 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/.tmp/cf/332ce5bae1644e07947c0636d6634acc as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/cf/332ce5bae1644e07947c0636d6634acc 2023-07-14 10:14:37,836 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/cf/332ce5bae1644e07947c0636d6634acc, entries=3, sequenceid=6, filesize=5.0 K 2023-07-14 10:14:37,837 INFO [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for cc52d3b6c8c30175a1c9159f1038fa98 in 247ms, sequenceid=6, compaction requested=false 2023-07-14 10:14:37,837 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc52d3b6c8c30175a1c9159f1038fa98: 2023-07-14 10:14:37,837 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:37,871 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:37,871 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/cf/332ce5bae1644e07947c0636d6634acc] hfiles 2023-07-14 10:14:37,871 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/cf/332ce5bae1644e07947c0636d6634acc for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,008 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. completed. 2023-07-14 10:14:38,009 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:38,009 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:38,009 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:38,009 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,009 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 10:14:38,009 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:14:38,016 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 10:14:38,016 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:38,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:38,016 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:38,016 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 10:14:38,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,39405,1689329547044': 2023-07-14 10:14:38,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 10:14:38,126 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. completed. 2023-07-14 10:14:38,126 DEBUG [rs(jenkins-hbase9.apache.org,43497,1689329547088)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:38,126 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:38,126 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:38,126 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,126 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 10:14:38,126 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:14:38,128 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,128 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 10:14:38,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:38,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:38,129 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:38,129 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 10:14:38,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:38,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:38,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:38,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,43497,1689329547088': 2023-07-14 10:14:38,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 10:14:38,138 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 10:14:38,138 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:14:38,138 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:14:38,138 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,138 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:14:38,140 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,140 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:38,140 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,140 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:38,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:38,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:38,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,142 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,142 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,142 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:38,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:38,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:38,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:38,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:38,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:38,143 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:38,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,144 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:38,145 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:38,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:38,149 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:38,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,149 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,150 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,156 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,156 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,156 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,156 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:38,156 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,156 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:38,156 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:38,156 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:38,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:38,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:38,156 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:38,156 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:38,159 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:38,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:38,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:38,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,156 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:38,156 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:38,160 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,160 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:38,160 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:38,160 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,160 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:38,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:38,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:38,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:38,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:38,176 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:38,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:14:38,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:38,178 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 10:14:38,274 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0005_000001 (auth:SIMPLE) 2023-07-14 10:14:38,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,649 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 10:14:38,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,650 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:38,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689329677066Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689329678160 (+1094 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689329678160Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689329678230 (+70 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689329678374 (+144 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689329678649 (+275 ms) 2023-07-14 10:14:38,654 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 10:14:38,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.5860 sec 2023-07-14 10:14:39,178 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:39,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 10:14:39,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:14:39,180 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329679180 2023-07-14 10:14:39,180 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36399, tgtDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329679180, rawTgtDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329679180, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:14:39,251 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:14:39,251 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1377735393_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329679180, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329679180/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:39,251 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-14 10:14:39,269 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329679180/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:39,326 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:39,327 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:39,327 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:39,328 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:39,712 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 10:14:40,371 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-4509435867128200008.jar 2023-07-14 10:14:40,372 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:40,372 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:40,450 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-8268720868401797697.jar 2023-07-14 10:14:40,450 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:40,450 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:40,451 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:40,451 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:40,451 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:40,452 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:40,452 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 10:14:40,452 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 10:14:40,453 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 10:14:40,453 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 10:14:40,453 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 10:14:40,454 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 10:14:40,454 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 10:14:40,455 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 10:14:40,455 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 10:14:40,455 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 10:14:40,456 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:40,456 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:40,457 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:14:40,457 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:40,457 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:40,458 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:14:40,459 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:14:42,279 WARN [Listener at jenkins-hbase9.apache.org/39497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 10:14:42,282 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-14 10:14:42,642 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:14:42,642 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:14:42,813 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0006_000001 (auth:SIMPLE) 2023-07-14 10:14:48,844 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0006_000001 (auth:SIMPLE) 2023-07-14 10:14:51,800 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 10:14:51,801 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 10:14:51,834 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:51,834 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 10:14:51,835 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 10:14:51,835 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:51,836 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 10:14:51,836 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 10:14:51,836 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329679180/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329679180/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:51,837 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329679180/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 10:14:51,837 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329679180/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 10:14:51,875 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-14 10:14:51,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-07-14 10:14:51,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 10:14:51,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 10:14:51,888 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329691887"}]},"ts":"1689329691887"} 2023-07-14 10:14:51,890 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 10:14:51,892 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-14 10:14:51,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc52d3b6c8c30175a1c9159f1038fa98, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a470ddeb9173a9da6b5f97bd73ae2f1, UNASSIGN}] 2023-07-14 10:14:51,895 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a470ddeb9173a9da6b5f97bd73ae2f1, UNASSIGN 2023-07-14 10:14:51,902 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8a470ddeb9173a9da6b5f97bd73ae2f1, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:51,902 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689329691902"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329691902"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329691902"}]},"ts":"1689329691902"} 2023-07-14 10:14:51,905 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc52d3b6c8c30175a1c9159f1038fa98, UNASSIGN 2023-07-14 10:14:51,906 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=cc52d3b6c8c30175a1c9159f1038fa98, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:51,906 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689329691906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329691906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329691906"}]},"ts":"1689329691906"} 2023-07-14 10:14:51,909 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure cc52d3b6c8c30175a1c9159f1038fa98, server=jenkins-hbase9.apache.org,43497,1689329547088}] 2023-07-14 10:14:51,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 8a470ddeb9173a9da6b5f97bd73ae2f1, server=jenkins-hbase9.apache.org,39405,1689329547044}] 2023-07-14 10:14:51,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 10:14:52,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:52,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing cc52d3b6c8c30175a1c9159f1038fa98, disabling compactions & flushes 2023-07-14 10:14:52,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:52,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:52,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. after waiting 0 ms 2023-07-14 10:14:52,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:52,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:52,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8a470ddeb9173a9da6b5f97bd73ae2f1, disabling compactions & flushes 2023-07-14 10:14:52,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:52,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:52,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. after waiting 0 ms 2023-07-14 10:14:52,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:52,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:14:52,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:14:52,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:14:52,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:14:52,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98. 2023-07-14 10:14:52,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for cc52d3b6c8c30175a1c9159f1038fa98: 2023-07-14 10:14:52,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1. 2023-07-14 10:14:52,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8a470ddeb9173a9da6b5f97bd73ae2f1: 2023-07-14 10:14:52,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:52,113 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=cc52d3b6c8c30175a1c9159f1038fa98, regionState=CLOSED 2023-07-14 10:14:52,114 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689329692113"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329692113"}]},"ts":"1689329692113"} 2023-07-14 10:14:52,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:52,114 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8a470ddeb9173a9da6b5f97bd73ae2f1, regionState=CLOSED 2023-07-14 10:14:52,114 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689329692114"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329692114"}]},"ts":"1689329692114"} 2023-07-14 10:14:52,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-14 10:14:52,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure cc52d3b6c8c30175a1c9159f1038fa98, server=jenkins-hbase9.apache.org,43497,1689329547088 in 212 msec 2023-07-14 10:14:52,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-14 10:14:52,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 8a470ddeb9173a9da6b5f97bd73ae2f1, server=jenkins-hbase9.apache.org,39405,1689329547044 in 219 msec 2023-07-14 10:14:52,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc52d3b6c8c30175a1c9159f1038fa98, UNASSIGN in 232 msec 2023-07-14 10:14:52,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-14 10:14:52,135 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a470ddeb9173a9da6b5f97bd73ae2f1, UNASSIGN in 236 msec 2023-07-14 10:14:52,137 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329692137"}]},"ts":"1689329692137"} 2023-07-14 10:14:52,138 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 10:14:52,140 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-14 10:14:52,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 266 msec 2023-07-14 10:14:52,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 10:14:52,190 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-14 10:14:52,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,197 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,199 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,200 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,204 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,204 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,204 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,204 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,205 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 10:14:52,205 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 10:14:52,205 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 10:14:52,206 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:52,206 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:52,206 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-14 10:14:52,206 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,206 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 10:14:52,206 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:52,207 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,207 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:52,206 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:52,214 DEBUG [HFileArchiver-25] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:52,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 10:14:52,231 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/recovered.edits] 2023-07-14 10:14:52,231 DEBUG [HFileArchiver-25] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/recovered.edits] 2023-07-14 10:14:52,239 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/cf/55031dfc02514af2a6697a8f747cbaf9 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/cf/55031dfc02514af2a6697a8f747cbaf9 2023-07-14 10:14:52,239 DEBUG [HFileArchiver-25] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/cf/332ce5bae1644e07947c0636d6634acc to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/cf/332ce5bae1644e07947c0636d6634acc 2023-07-14 10:14:52,244 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1/recovered.edits/9.seqid 2023-07-14 10:14:52,245 DEBUG [HFileArchiver-25] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98/recovered.edits/9.seqid 2023-07-14 10:14:52,245 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a470ddeb9173a9da6b5f97bd73ae2f1 2023-07-14 10:14:52,246 DEBUG [HFileArchiver-25] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc52d3b6c8c30175a1c9159f1038fa98 2023-07-14 10:14:52,246 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 10:14:52,248 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,265 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-14 10:14:52,276 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-14 10:14:52,282 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,282 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-14 10:14:52,282 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329692282"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:52,283 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329692282"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:52,300 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 10:14:52,300 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cc52d3b6c8c30175a1c9159f1038fa98, NAME => 'testtb-testEmptyExportFileSystemState,,1689329674866.cc52d3b6c8c30175a1c9159f1038fa98.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8a470ddeb9173a9da6b5f97bd73ae2f1, NAME => 'testtb-testEmptyExportFileSystemState,1,1689329674866.8a470ddeb9173a9da6b5f97bd73ae2f1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 10:14:52,300 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-14 10:14:52,300 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689329692300"}]},"ts":"9223372036854775807"} 2023-07-14 10:14:52,315 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-14 10:14:52,318 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 10:14:52,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 127 msec 2023-07-14 10:14:52,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 10:14:52,323 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-14 10:14:52,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-14 10:14:52,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:52,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-14 10:14:52,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-14 10:14:52,410 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 757) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1495568783_1 at /127.0.0.1:50290 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:49544 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1109605716) connection to jenkins-hbase9.apache.org/172.31.2.10:36767 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1109605716) connection to jenkins-hbase9.apache.org/172.31.2.10:43567 from appattempt_1689329557477_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1109605716) connection to jenkins-hbase9.apache.org/172.31.2.10:46071 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52ff4eb1-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4489 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #2 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:47398 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_493460587_17 at /127.0.0.1:42726 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1495568783_1 at /127.0.0.1:35698 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1136 (was 1217), ProcessCount=184 (was 192), AvailableMemoryMB=2455 (was 504) - AvailableMemoryMB LEAK? - 2023-07-14 10:14:52,410 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 10:14:52,440 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=1136, ProcessCount=184, AvailableMemoryMB=2450 2023-07-14 10:14:52,441 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 10:14:52,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 10:14:52,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:52,448 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 10:14:52,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-14 10:14:52,449 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 10:14:52,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 10:14:52,452 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:14:52,452 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142 2023-07-14 10:14:52,453 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6 empty. 2023-07-14 10:14:52,453 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142 empty. 2023-07-14 10:14:52,454 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142 2023-07-14 10:14:52,454 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:14:52,454 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 10:14:52,473 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-14 10:14:52,486 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4b98a7292b3dd50cb89b43ebaa8cbdd6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:14:52,490 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => d77affb47ddd61370ef05a6387848142, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp 2023-07-14 10:14:52,551 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:52,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 10:14:52,551 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing d77affb47ddd61370ef05a6387848142, disabling compactions & flushes 2023-07-14 10:14:52,551 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:14:52,551 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:14:52,551 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. after waiting 0 ms 2023-07-14 10:14:52,551 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:14:52,551 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:14:52,551 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for d77affb47ddd61370ef05a6387848142: 2023-07-14 10:14:52,559 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:52,560 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 4b98a7292b3dd50cb89b43ebaa8cbdd6, disabling compactions & flushes 2023-07-14 10:14:52,560 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:52,560 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:52,560 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. after waiting 0 ms 2023-07-14 10:14:52,560 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:52,560 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:52,560 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 4b98a7292b3dd50cb89b43ebaa8cbdd6: 2023-07-14 10:14:52,563 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 10:14:52,564 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689329692563"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329692563"}]},"ts":"1689329692563"} 2023-07-14 10:14:52,564 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689329692563"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329692563"}]},"ts":"1689329692563"} 2023-07-14 10:14:52,570 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 10:14:52,571 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 10:14:52,571 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329692571"}]},"ts":"1689329692571"} 2023-07-14 10:14:52,573 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-14 10:14:52,577 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 10:14:52,579 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 10:14:52,579 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 10:14:52,579 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 10:14:52,579 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 10:14:52,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4b98a7292b3dd50cb89b43ebaa8cbdd6, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d77affb47ddd61370ef05a6387848142, ASSIGN}] 2023-07-14 10:14:52,582 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4b98a7292b3dd50cb89b43ebaa8cbdd6, ASSIGN 2023-07-14 10:14:52,582 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d77affb47ddd61370ef05a6387848142, ASSIGN 2023-07-14 10:14:52,583 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4b98a7292b3dd50cb89b43ebaa8cbdd6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39405,1689329547044; forceNewPlan=false, retain=false 2023-07-14 10:14:52,584 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d77affb47ddd61370ef05a6387848142, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35921,1689329546985; forceNewPlan=false, retain=false 2023-07-14 10:14:52,733 INFO [jenkins-hbase9:39063] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 10:14:52,737 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4b98a7292b3dd50cb89b43ebaa8cbdd6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:52,737 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d77affb47ddd61370ef05a6387848142, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:52,738 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689329692737"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329692737"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329692737"}]},"ts":"1689329692737"} 2023-07-14 10:14:52,738 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689329692737"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329692737"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329692737"}]},"ts":"1689329692737"} 2023-07-14 10:14:52,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure d77affb47ddd61370ef05a6387848142, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:14:52,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 4b98a7292b3dd50cb89b43ebaa8cbdd6, server=jenkins-hbase9.apache.org,39405,1689329547044}] 2023-07-14 10:14:52,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 10:14:52,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:14:52,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d77affb47ddd61370ef05a6387848142, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 10:14:52,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. service=AccessControlService 2023-07-14 10:14:52,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:14:52,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp d77affb47ddd61370ef05a6387848142 2023-07-14 10:14:52,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:52,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d77affb47ddd61370ef05a6387848142 2023-07-14 10:14:52,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d77affb47ddd61370ef05a6387848142 2023-07-14 10:14:52,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:52,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b98a7292b3dd50cb89b43ebaa8cbdd6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 10:14:52,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. service=AccessControlService 2023-07-14 10:14:52,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 10:14:52,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:14:52,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 10:14:52,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:14:52,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:14:52,917 INFO [StoreOpener-d77affb47ddd61370ef05a6387848142-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d77affb47ddd61370ef05a6387848142 2023-07-14 10:14:52,917 INFO [StoreOpener-4b98a7292b3dd50cb89b43ebaa8cbdd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:14:52,920 DEBUG [StoreOpener-d77affb47ddd61370ef05a6387848142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/cf 2023-07-14 10:14:52,920 DEBUG [StoreOpener-d77affb47ddd61370ef05a6387848142-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/cf 2023-07-14 10:14:52,921 INFO [StoreOpener-d77affb47ddd61370ef05a6387848142-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d77affb47ddd61370ef05a6387848142 columnFamilyName cf 2023-07-14 10:14:52,922 INFO [StoreOpener-d77affb47ddd61370ef05a6387848142-1] regionserver.HStore(310): Store=d77affb47ddd61370ef05a6387848142/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:14:52,922 DEBUG [StoreOpener-4b98a7292b3dd50cb89b43ebaa8cbdd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/cf 2023-07-14 10:14:52,923 DEBUG [StoreOpener-4b98a7292b3dd50cb89b43ebaa8cbdd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/cf 2023-07-14 10:14:52,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142 2023-07-14 10:14:52,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142 2023-07-14 10:14:52,926 INFO [StoreOpener-4b98a7292b3dd50cb89b43ebaa8cbdd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b98a7292b3dd50cb89b43ebaa8cbdd6 columnFamilyName cf 2023-07-14 10:14:52,926 INFO [StoreOpener-4b98a7292b3dd50cb89b43ebaa8cbdd6-1] regionserver.HStore(310): Store=4b98a7292b3dd50cb89b43ebaa8cbdd6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 10:14:52,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d77affb47ddd61370ef05a6387848142 2023-07-14 10:14:52,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:14:52,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:14:52,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:14:52,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d77affb47ddd61370ef05a6387848142; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75135295, jitterRate=0.11960314214229584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:14:52,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d77affb47ddd61370ef05a6387848142: 2023-07-14 10:14:52,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:14:52,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142., pid=108, masterSystemTime=1689329692893 2023-07-14 10:14:52,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 10:14:52,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 4b98a7292b3dd50cb89b43ebaa8cbdd6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68789467, jitterRate=0.025042936205863953}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 10:14:52,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 4b98a7292b3dd50cb89b43ebaa8cbdd6: 2023-07-14 10:14:52,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:14:52,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:14:52,937 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=d77affb47ddd61370ef05a6387848142, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:52,937 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689329692937"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329692937"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329692937"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329692937"}]},"ts":"1689329692937"} 2023-07-14 10:14:52,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6., pid=109, masterSystemTime=1689329692902 2023-07-14 10:14:52,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-14 10:14:52,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure d77affb47ddd61370ef05a6387848142, server=jenkins-hbase9.apache.org,35921,1689329546985 in 199 msec 2023-07-14 10:14:52,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:52,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:52,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d77affb47ddd61370ef05a6387848142, ASSIGN in 362 msec 2023-07-14 10:14:52,943 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4b98a7292b3dd50cb89b43ebaa8cbdd6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:52,944 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689329692943"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689329692943"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689329692943"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689329692943"}]},"ts":"1689329692943"} 2023-07-14 10:14:52,948 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-14 10:14:52,948 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 4b98a7292b3dd50cb89b43ebaa8cbdd6, server=jenkins-hbase9.apache.org,39405,1689329547044 in 204 msec 2023-07-14 10:14:52,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-14 10:14:52,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4b98a7292b3dd50cb89b43ebaa8cbdd6, ASSIGN in 369 msec 2023-07-14 10:14:52,952 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 10:14:52,952 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329692952"}]},"ts":"1689329692952"} 2023-07-14 10:14:52,954 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-14 10:14:52,957 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 10:14:52,957 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-14 10:14:52,962 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 10:14:52,964 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:52,964 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:52,964 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:52,964 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:14:52,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:52,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:52,974 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:52,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 10:14:52,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 532 msec 2023-07-14 10:14:53,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 10:14:53,054 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-14 10:14:53,054 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-14 10:14:53,054 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:14:53,058 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-14 10:14:53,058 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:14:53,058 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-14 10:14:53,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 10:14:53,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329693061 (current time:1689329693061). 2023-07-14 10:14:53,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:14:53,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x5bfd5500 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:53,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f114d5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:53,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:53,090 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:53,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bfd5500 to 127.0.0.1:60034 2023-07-14 10:14:53,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:53,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x6d62a1c8 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:53,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c06ac31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:53,160 DEBUG [hconnection-0x49686152-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:53,165 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:53,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d62a1c8 to 127.0.0.1:60034 2023-07-14 10:14:53,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:53,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 10:14:53,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:14:53,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 10:14:53,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 10:14:53,180 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 10:14:53,181 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689330293181 2023-07-14 10:14:53,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 10:14:53,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,183 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:14:53,183 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:14:53,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 10:14:53,187 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 10:14:53,189 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 11 msec 2023-07-14 10:14:53,191 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 10:14:53,192 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689330293192 2023-07-14 10:14:53,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,252 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 10:14:53,252 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:53,254 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 10:14:53,254 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 10:14:53,279 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,279 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,280 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:53,280 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:53,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:53,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:53,280 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,280 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:53,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:53,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:53,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:53,281 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,281 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,282 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,282 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:14:53,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 10:14:53,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,283 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 10:14:53,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 10:14:53,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,283 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 10:14:53,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 10:14:53,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,283 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:53,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 10:14:53,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 10:14:53,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:53,285 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:14:53,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,294 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 10:14:53,294 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:53,303 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 10:14:53,303 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 10:14:53,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,303 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 10:14:53,303 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 10:14:53,303 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 10:14:53,304 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:53,303 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:53,305 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 10:14:53,306 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 10:14:53,306 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 10:14:53,306 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 10:14:53,307 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 10:14:53,307 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 10:14:53,312 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:53,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:53,312 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:53,313 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,313 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,313 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,314 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:53,313 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,314 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,314 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:53,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:53,314 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,314 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:53,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:53,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 10:14:53,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e3b131a[Count = 1] remaining members to acquire global barrier 2023-07-14 10:14:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:53,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:53,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:53,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:53,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:53,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 10:14:53,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e3b131a[Count = 0] remaining members to acquire global barrier 2023-07-14 10:14:53,319 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 10:14:53,319 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,320 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,320 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,320 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,321 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 10:14:53,321 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 10:14:53,321 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 10:14:53,321 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:14:53,321 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,321 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:53,321 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:53,321 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:53,322 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. started... 2023-07-14 10:14:53,323 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 10:14:53,323 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:53,323 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 10:14:53,326 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 10:14:53,328 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b98a7292b3dd50cb89b43ebaa8cbdd6: 2023-07-14 10:14:53,328 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,328 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:53,328 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:14:53,329 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:53,331 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:53,329 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,331 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:14:53,331 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:14:53,332 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. started... 2023-07-14 10:14:53,333 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d77affb47ddd61370ef05a6387848142: 2023-07-14 10:14:53,334 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,334 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:53,334 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 10:14:53,450 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. completed. 2023-07-14 10:14:53,450 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:53,450 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:53,450 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:53,450 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,450 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 10:14:53,450 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:14:53,451 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. completed. 2023-07-14 10:14:53,451 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:14:53,451 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:53,451 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:53,451 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,451 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 10:14:53,451 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:14:53,452 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 10:14:53,452 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,452 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,452 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 10:14:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:53,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:53,456 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,461 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 10:14:53,461 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:53,461 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 10:14:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,39405,1689329547044': 2023-07-14 10:14:53,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 10:14:53,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:53,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:53,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:53,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:53,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,35921,1689329546985': 2023-07-14 10:14:53,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 10:14:53,480 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 10:14:53,480 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:14:53,480 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:14:53,480 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,480 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:14:53,483 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,483 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,483 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:53,483 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:53,483 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,483 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:53,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,483 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:53,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,485 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,485 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:53,485 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,486 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 10:14:53,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:53,489 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:14:53,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:53,492 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,492 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,493 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,498 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:53,498 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:53,498 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:53,498 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:53,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:53,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:53,498 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:53,498 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:53,498 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:53,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:53,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:53,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:53,499 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,499 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,499 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,499 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,499 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:53,499 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,499 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:53,499 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:53,499 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,499 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,499 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:53,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,600 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 10:14:53,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,600 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689329693181Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689329693501 (+320 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689329693501Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689329693506 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689329693535 (+29 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689329693600 (+65 ms) 2023-07-14 10:14:53,604 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 10:14:53,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 421 msec 2023-07-14 10:14:53,789 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:53,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 10:14:53,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:14:53,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39405] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:14:53,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35921] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 10:14:53,828 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,828 DEBUG [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:53,828 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 10:14:53,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 10:14:53,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689329693867 (current time:1689329693867). 2023-07-14 10:14:53,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 10:14:53,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x0b7576c7 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:53,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11df40a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:53,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:53,906 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:53,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b7576c7 to 127.0.0.1:60034 2023-07-14 10:14:53,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:53,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(139): Connect 0x5d26b136 to 127.0.0.1:60034 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 10:14:53,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dc5371b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 10:14:53,923 DEBUG [hconnection-0x1316210d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 10:14:53,924 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49100, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 10:14:53,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d26b136 to 127.0.0.1:60034 2023-07-14 10:14:53,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:14:53,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 10:14:53,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 10:14:53,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 10:14:53,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 10:14:53,945 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 10:14:53,946 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689330293946 2023-07-14 10:14:53,947 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:53,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 10:14:53,947 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 10:14:53,947 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 10:14:53,952 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 10:14:53,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 10:14:53,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 14 msec 2023-07-14 10:14:53,955 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 10:14:53,956 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689330293956 2023-07-14 10:14:54,047 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:54,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 10:14:54,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:54,056 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 10:14:54,056 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:54,056 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 10:14:54,056 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 10:14:54,056 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 10:14:54,057 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,057 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,058 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:54,058 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:54,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:54,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:54,058 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:54,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:54,058 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:54,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:54,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:54,060 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,060 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,061 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,061 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 10:14:54,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 10:14:54,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,061 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 10:14:54,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 10:14:54,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,062 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 10:14:54,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 10:14:54,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,063 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 10:14:54,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,070 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 10:14:54,070 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:54,070 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,073 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 10:14:54,073 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:54,073 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 10:14:54,073 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 10:14:54,073 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 10:14:54,076 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 10:14:54,076 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 10:14:54,075 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 10:14:54,079 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 10:14:54,080 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 10:14:54,079 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 10:14:54,080 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 10:14:54,080 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,43497,1689329547088' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 10:14:54,081 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,081 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:54,082 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,082 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:54,082 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,082 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,082 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:54,083 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,083 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:54,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:54,083 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,083 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 10:14:54,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:54,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39405,1689329547044' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 10:14:54,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@167938c7[Count = 1] remaining members to acquire global barrier 2023-07-14 10:14:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:54,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35921,1689329546985' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 10:14:54,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@167938c7[Count = 0] remaining members to acquire global barrier 2023-07-14 10:14:54,090 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 10:14:54,091 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,097 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,097 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,097 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 10:14:54,098 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,098 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:54,098 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:54,098 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:54,098 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 10:14:54,098 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. started... 2023-07-14 10:14:54,098 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4b98a7292b3dd50cb89b43ebaa8cbdd6 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 10:14:54,102 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,102 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 10:14:54,102 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,103 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 10:14:54,103 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 10:14:54,103 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,43497,1689329547088' in zk 2023-07-14 10:14:54,102 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 10:14:54,103 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 10:14:54,103 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:14:54,103 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. started... 2023-07-14 10:14:54,105 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d77affb47ddd61370ef05a6387848142 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 10:14:54,108 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 10:14:54,108 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:54,108 DEBUG [member: 'jenkins-hbase9.apache.org,43497,1689329547088' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 10:14:54,182 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/.tmp/cf/718fceb227424d75abab36a444ac3699 2023-07-14 10:14:54,189 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/.tmp/cf/718fceb227424d75abab36a444ac3699 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/cf/718fceb227424d75abab36a444ac3699 2023-07-14 10:14:54,194 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/.tmp/cf/17d91b4f941143adbf7f6cc8391e14af 2023-07-14 10:14:54,196 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/cf/718fceb227424d75abab36a444ac3699, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 10:14:54,197 INFO [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for d77affb47ddd61370ef05a6387848142 in 94ms, sequenceid=6, compaction requested=false 2023-07-14 10:14:54,197 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-14 10:14:54,201 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d77affb47ddd61370ef05a6387848142: 2023-07-14 10:14:54,201 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,201 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:54,201 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/cf/718fceb227424d75abab36a444ac3699] hfiles 2023-07-14 10:14:54,201 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/cf/718fceb227424d75abab36a444ac3699 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,211 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/.tmp/cf/17d91b4f941143adbf7f6cc8391e14af as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/cf/17d91b4f941143adbf7f6cc8391e14af 2023-07-14 10:14:54,219 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/cf/17d91b4f941143adbf7f6cc8391e14af, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 10:14:54,220 INFO [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 4b98a7292b3dd50cb89b43ebaa8cbdd6 in 122ms, sequenceid=6, compaction requested=false 2023-07-14 10:14:54,228 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b98a7292b3dd50cb89b43ebaa8cbdd6: 2023-07-14 10:14:54,228 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,228 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 10:14:54,228 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/cf/17d91b4f941143adbf7f6cc8391e14af] hfiles 2023-07-14 10:14:54,228 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/cf/17d91b4f941143adbf7f6cc8391e14af for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,238 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. completed. 2023-07-14 10:14:54,238 DEBUG [rs(jenkins-hbase9.apache.org,35921,1689329546985)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:14:54,238 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:54,238 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:54,238 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,238 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 10:14:54,238 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,35921,1689329546985' in zk 2023-07-14 10:14:54,240 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,240 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 10:14:54,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:54,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:54,240 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:54,240 DEBUG [member: 'jenkins-hbase9.apache.org,35921,1689329546985' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 10:14:54,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:54,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:54,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:54,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,35921,1689329546985': 2023-07-14 10:14:54,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35921,1689329546985' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 10:14:54,252 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. completed. 2023-07-14 10:14:54,252 DEBUG [rs(jenkins-hbase9.apache.org,39405,1689329547044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:14:54,252 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 10:14:54,252 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 10:14:54,252 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,252 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 10:14:54,252 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,39405,1689329547044' in zk 2023-07-14 10:14:54,254 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:54,255 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 10:14:54,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:54,255 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:54,255 DEBUG [member: 'jenkins-hbase9.apache.org,39405,1689329547044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 10:14:54,256 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:54,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:54,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 10:14:54,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 10:14:54,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:54,258 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 10:14:54,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:54,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,39405,1689329547044': 2023-07-14 10:14:54,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39405,1689329547044' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 10:14:54,264 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 10:14:54,264 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 10:14:54,264 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 10:14:54,264 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,264 INFO [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 10:14:54,267 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,267 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:54,267 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,267 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,267 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 10:14:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 10:14:54,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,267 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:54,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,267 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:54,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:54,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 10:14:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,268 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,269 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 10:14:54,270 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 10:14:54,271 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,272 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,272 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,275 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:54,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:54,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:14:54,276 DEBUG [(jenkins-hbase9.apache.org,39063,1689329545379)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 10:14:54,275 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:54,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 10:14:54,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:54,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:54,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:54,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:54,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 10:14:54,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 10:14:54,278 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:14:54,278 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:54,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 10:14:54,279 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:14:54,279 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,279 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:54,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:54,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:54,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:54,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 10:14:54,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 10:14:54,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,386 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 10:14:54,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,386 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689329693947Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689329694278 (+331 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689329694278Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689329694283 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689329694299 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689329694386 (+87 ms) 2023-07-14 10:14:54,390 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 10:14:54,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 440 msec 2023-07-14 10:14:54,558 DEBUG [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 10:14:54,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 10:14:54,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 10:14:54,559 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329694559 2023-07-14 10:14:54,560 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36399, tgtDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329694559, rawTgtDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329694559, srcFsUri=hdfs://localhost:36399, srcDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:14:54,596 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a 2023-07-14 10:14:54,596 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1670802951_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329694559, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329694559/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,596 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36399, inputRoot=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a, snapshotDir=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-14 10:14:54,609 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329694559/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:14:54,664 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:54,664 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:54,665 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:54,665 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:55,839 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-8524154761992047707.jar 2023-07-14 10:14:55,840 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:55,840 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:55,928 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/hadoop-881689909793918258.jar 2023-07-14 10:14:55,929 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:55,929 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:55,930 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:55,930 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:55,931 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:55,931 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 10:14:55,932 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 10:14:55,932 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 10:14:55,933 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 10:14:55,933 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 10:14:55,934 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 10:14:55,934 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 10:14:55,935 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 10:14:55,935 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 10:14:55,935 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 10:14:55,936 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 10:14:55,937 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:55,937 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:55,938 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:14:55,939 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:55,939 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 10:14:55,940 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:14:55,941 DEBUG [Listener at jenkins-hbase9.apache.org/39497] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 10:14:56,372 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0006_000001 (auth:SIMPLE) 2023-07-14 10:14:57,817 WARN [DataStreamer for file /user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689329557477_0007/libjars/hbase-replication-2.4.18-SNAPSHOT.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-14 10:14:57,876 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 10:14:57,897 WARN [Listener at jenkins-hbase9.apache.org/39497] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 10:14:57,900 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-14 10:14:57,923 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 10:14:58,649 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:14:58,649 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 10:14:59,244 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0007_000001 (auth:SIMPLE) 2023-07-14 10:15:06,206 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0007_000001 (auth:SIMPLE) 2023-07-14 10:15:08,559 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0007_000001 (auth:SIMPLE) 2023-07-14 10:15:14,319 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689329557477_0007_000001 (auth:SIMPLE) 2023-07-14 10:15:15,912 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 10:15:15,912 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 10:15:15,935 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:15,935 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 10:15:15,936 INFO [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 10:15:15,936 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:15,936 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 10:15:15,936 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 10:15:15,936 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_493460587_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329694559/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329694559/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:15,937 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329694559/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 10:15:15,937 DEBUG [Listener at jenkins-hbase9.apache.org/39497] snapshot.TestExportSnapshot(367): hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/export-test/export-1689329694559/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 10:15:15,950 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:15,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:15,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:15,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 10:15:15,958 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329715958"}]},"ts":"1689329715958"} 2023-07-14 10:15:15,960 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-14 10:15:15,961 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-14 10:15:15,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4b98a7292b3dd50cb89b43ebaa8cbdd6, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d77affb47ddd61370ef05a6387848142, UNASSIGN}] 2023-07-14 10:15:15,965 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4b98a7292b3dd50cb89b43ebaa8cbdd6, UNASSIGN 2023-07-14 10:15:15,965 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d77affb47ddd61370ef05a6387848142, UNASSIGN 2023-07-14 10:15:15,966 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=d77affb47ddd61370ef05a6387848142, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:15:15,966 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4b98a7292b3dd50cb89b43ebaa8cbdd6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:15:15,966 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689329715966"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329715966"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329715966"}]},"ts":"1689329715966"} 2023-07-14 10:15:15,966 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689329715966"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689329715966"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689329715966"}]},"ts":"1689329715966"} 2023-07-14 10:15:15,967 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 4b98a7292b3dd50cb89b43ebaa8cbdd6, server=jenkins-hbase9.apache.org,39405,1689329547044}] 2023-07-14 10:15:15,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure d77affb47ddd61370ef05a6387848142, server=jenkins-hbase9.apache.org,35921,1689329546985}] 2023-07-14 10:15:16,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 10:15:16,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:15:16,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 4b98a7292b3dd50cb89b43ebaa8cbdd6, disabling compactions & flushes 2023-07-14 10:15:16,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:15:16,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:15:16,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. after waiting 0 ms 2023-07-14 10:15:16,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:15:16,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d77affb47ddd61370ef05a6387848142 2023-07-14 10:15:16,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d77affb47ddd61370ef05a6387848142, disabling compactions & flushes 2023-07-14 10:15:16,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:15:16,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:15:16,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. after waiting 0 ms 2023-07-14 10:15:16,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:15:16,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:15:16,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:16,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142. 2023-07-14 10:15:16,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:15:16,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d77affb47ddd61370ef05a6387848142: 2023-07-14 10:15:16,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:16,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6. 2023-07-14 10:15:16,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 4b98a7292b3dd50cb89b43ebaa8cbdd6: 2023-07-14 10:15:16,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d77affb47ddd61370ef05a6387848142 2023-07-14 10:15:16,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:15:16,185 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=d77affb47ddd61370ef05a6387848142, regionState=CLOSED 2023-07-14 10:15:16,185 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689329716185"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329716185"}]},"ts":"1689329716185"} 2023-07-14 10:15:16,186 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4b98a7292b3dd50cb89b43ebaa8cbdd6, regionState=CLOSED 2023-07-14 10:15:16,186 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689329716186"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689329716186"}]},"ts":"1689329716186"} 2023-07-14 10:15:16,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-14 10:15:16,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure d77affb47ddd61370ef05a6387848142, server=jenkins-hbase9.apache.org,35921,1689329546985 in 219 msec 2023-07-14 10:15:16,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-14 10:15:16,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 4b98a7292b3dd50cb89b43ebaa8cbdd6, server=jenkins-hbase9.apache.org,39405,1689329547044 in 221 msec 2023-07-14 10:15:16,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=d77affb47ddd61370ef05a6387848142, UNASSIGN in 228 msec 2023-07-14 10:15:16,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-14 10:15:16,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4b98a7292b3dd50cb89b43ebaa8cbdd6, UNASSIGN in 229 msec 2023-07-14 10:15:16,194 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689329716193"}]},"ts":"1689329716193"} 2023-07-14 10:15:16,195 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-14 10:15:16,197 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-14 10:15:16,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 246 msec 2023-07-14 10:15:16,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 10:15:16,261 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-14 10:15:16,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,267 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,269 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35921] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,269 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,273 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,273 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,273 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,273 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 10:15:16,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 10:15:16,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 10:15:16,274 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 10:15:16,275 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,275 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,275 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:15:16,275 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:15:16,275 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,275 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:15:16,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,276 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 10:15:16,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 10:15:16,278 DEBUG [HFileArchiver-26] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:15:16,282 DEBUG [HFileArchiver-27] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142 2023-07-14 10:15:16,283 DEBUG [HFileArchiver-26] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/recovered.edits] 2023-07-14 10:15:16,284 DEBUG [HFileArchiver-27] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/cf, FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/recovered.edits] 2023-07-14 10:15:16,291 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/cf/17d91b4f941143adbf7f6cc8391e14af to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/cf/17d91b4f941143adbf7f6cc8391e14af 2023-07-14 10:15:16,291 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/cf/718fceb227424d75abab36a444ac3699 to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/cf/718fceb227424d75abab36a444ac3699 2023-07-14 10:15:16,296 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6/recovered.edits/9.seqid 2023-07-14 10:15:16,296 DEBUG [HFileArchiver-26] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4b98a7292b3dd50cb89b43ebaa8cbdd6 2023-07-14 10:15:16,296 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/recovered.edits/9.seqid to hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142/recovered.edits/9.seqid 2023-07-14 10:15:16,298 DEBUG [HFileArchiver-27] backup.HFileArchiver(596): Deleted hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/d77affb47ddd61370ef05a6387848142 2023-07-14 10:15:16,298 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 10:15:16,301 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,303 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-14 10:15:16,306 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-14 10:15:16,307 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,307 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-14 10:15:16,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329716307"}]},"ts":"9223372036854775807"} 2023-07-14 10:15:16,307 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689329716307"}]},"ts":"9223372036854775807"} 2023-07-14 10:15:16,311 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 10:15:16,311 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4b98a7292b3dd50cb89b43ebaa8cbdd6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689329692442.4b98a7292b3dd50cb89b43ebaa8cbdd6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d77affb47ddd61370ef05a6387848142, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689329692442.d77affb47ddd61370ef05a6387848142.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 10:15:16,311 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-14 10:15:16,312 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689329716312"}]},"ts":"9223372036854775807"} 2023-07-14 10:15:16,317 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-14 10:15:16,323 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 60 msec 2023-07-14 10:15:16,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 10:15:16,377 INFO [Listener at jenkins-hbase9.apache.org/39497] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-14 10:15:16,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 10:15:16,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 10:15:16,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39063] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 10:15:16,428 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 763), OpenFileDescriptor=906 (was 912), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1131 (was 1136), ProcessCount=187 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=1259 (was 2450) 2023-07-14 10:15:16,428 WARN [Listener at jenkins-hbase9.apache.org/39497] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 10:15:16,428 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-14 10:15:16,444 INFO [Listener at jenkins-hbase9.apache.org/39497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 10:15:16,577 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689329557477_0007_01_000001 is : 143 2023-07-14 10:15:21,807 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 10:15:30,589 INFO [Listener at jenkins-hbase9.apache.org/39497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 10:15:44,709 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 10:15:44,710 INFO [Listener at jenkins-hbase9.apache.org/39497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 10:15:44,822 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-14 10:15:44,832 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-14 10:15:44,833 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 10:15:44,848 INFO [Listener at jenkins-hbase9.apache.org/39497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 10:15:44,952 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 10:15:44,953 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-14 10:15:44,953 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-14 10:15:44,953 INFO [Listener at jenkins-hbase9.apache.org/39497] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 10:15:44,953 DEBUG [Listener at jenkins-hbase9.apache.org/39497] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44e82ad3 to 127.0.0.1:60034 2023-07-14 10:15:44,953 DEBUG [Listener at jenkins-hbase9.apache.org/39497] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:15:44,953 DEBUG [Listener at jenkins-hbase9.apache.org/39497] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-14 10:15:44,953 DEBUG [Listener at jenkins-hbase9.apache.org/39497] util.JVMClusterUtil(257): Found active master hash=1422749264, stopped=false 2023-07-14 10:15:44,954 DEBUG [Listener at jenkins-hbase9.apache.org/39497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:44,954 DEBUG [Listener at jenkins-hbase9.apache.org/39497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 10:15:44,954 INFO [Listener at jenkins-hbase9.apache.org/39497] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,39063,1689329545379 2023-07-14 10:15:44,956 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 10:15:44,956 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 10:15:44,956 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 10:15:44,956 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 10:15:44,956 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 10:15:44,956 INFO [Listener at jenkins-hbase9.apache.org/39497] procedure2.ProcedureExecutor(629): Stopping 2023-07-14 10:15:44,957 DEBUG [Listener at jenkins-hbase9.apache.org/39497] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6643fc6c to 127.0.0.1:60034 2023-07-14 10:15:44,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 10:15:44,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 10:15:44,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 10:15:44,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 10:15:44,957 DEBUG [Listener at jenkins-hbase9.apache.org/39497] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:15:44,957 INFO [Listener at jenkins-hbase9.apache.org/39497] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,35921,1689329546985' ***** 2023-07-14 10:15:44,957 DEBUG [Listener at jenkins-hbase9.apache.org/39497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:44,958 INFO [Listener at jenkins-hbase9.apache.org/39497] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 10:15:44,958 INFO [Listener at jenkins-hbase9.apache.org/39497] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,39405,1689329547044' ***** 2023-07-14 10:15:44,958 DEBUG [Listener at jenkins-hbase9.apache.org/39497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:44,958 INFO [Listener at jenkins-hbase9.apache.org/39497] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 10:15:44,958 INFO [RS:0;jenkins-hbase9:35921] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 10:15:44,958 INFO [Listener at jenkins-hbase9.apache.org/39497] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,43497,1689329547088' ***** 2023-07-14 10:15:44,958 DEBUG [Listener at jenkins-hbase9.apache.org/39497] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:44,958 INFO [Listener at jenkins-hbase9.apache.org/39497] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 10:15:44,958 INFO [RS:0;jenkins-hbase9:35921] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 10:15:44,958 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 10:15:44,958 INFO [RS:0;jenkins-hbase9:35921] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 10:15:44,958 INFO [RS:1;jenkins-hbase9:39405] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 10:15:44,958 INFO [RS:1;jenkins-hbase9:39405] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 10:15:44,958 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 10:15:44,959 INFO [RS:1;jenkins-hbase9:39405] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 10:15:44,959 INFO [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(3305): Received CLOSE for 2d522901cedf9b58bda29b84a423cc3c 2023-07-14 10:15:44,959 INFO [RS:2;jenkins-hbase9:43497] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 10:15:44,959 INFO [RS:2;jenkins-hbase9:43497] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 10:15:44,959 INFO [RS:2;jenkins-hbase9:43497] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 10:15:44,959 INFO [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:15:44,959 INFO [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:15:44,959 DEBUG [RS:0;jenkins-hbase9:35921] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x143df10f to 127.0.0.1:60034 2023-07-14 10:15:44,959 DEBUG [RS:1;jenkins-hbase9:39405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x210ba5b5 to 127.0.0.1:60034 2023-07-14 10:15:44,959 DEBUG [RS:1;jenkins-hbase9:39405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:15:44,959 INFO [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(3305): Received CLOSE for 3a1db46edb9b173bb9b26f17faccad93 2023-07-14 10:15:44,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2d522901cedf9b58bda29b84a423cc3c, disabling compactions & flushes 2023-07-14 10:15:44,959 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 10:15:44,961 INFO [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,39405,1689329547044; all regions closed. 2023-07-14 10:15:44,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:15:44,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:15:44,961 INFO [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:15:44,962 DEBUG [RS:2;jenkins-hbase9:43497] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48048430 to 127.0.0.1:60034 2023-07-14 10:15:44,962 DEBUG [RS:2;jenkins-hbase9:43497] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:15:44,959 DEBUG [RS:0;jenkins-hbase9:35921] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:15:44,964 INFO [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-14 10:15:44,964 INFO [RS:0;jenkins-hbase9:35921] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 10:15:44,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. after waiting 0 ms 2023-07-14 10:15:44,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3a1db46edb9b173bb9b26f17faccad93, disabling compactions & flushes 2023-07-14 10:15:44,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:15:44,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:15:44,964 INFO [RS:0;jenkins-hbase9:35921] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 10:15:44,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 2d522901cedf9b58bda29b84a423cc3c 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-14 10:15:44,964 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1478): Online Regions={3a1db46edb9b173bb9b26f17faccad93=hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93.} 2023-07-14 10:15:44,965 INFO [RS:0;jenkins-hbase9:35921] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 10:15:44,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:15:44,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. after waiting 0 ms 2023-07-14 10:15:44,965 INFO [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-14 10:15:44,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:15:44,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 3a1db46edb9b173bb9b26f17faccad93 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-14 10:15:44,966 DEBUG [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1504): Waiting on 3a1db46edb9b173bb9b26f17faccad93 2023-07-14 10:15:44,966 INFO [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-14 10:15:44,966 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1478): Online Regions={2d522901cedf9b58bda29b84a423cc3c=hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c., 1588230740=hbase:meta,,1.1588230740} 2023-07-14 10:15:44,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 10:15:44,967 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1504): Waiting on 1588230740, 2d522901cedf9b58bda29b84a423cc3c 2023-07-14 10:15:44,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 10:15:44,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 10:15:44,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 10:15:44,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 10:15:44,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-14 10:15:44,989 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 10:15:45,004 DEBUG [RS:1;jenkins-hbase9:39405] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/oldWALs 2023-07-14 10:15:45,004 INFO [RS:1;jenkins-hbase9:39405] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39405%2C1689329547044:(num 1689329549634) 2023-07-14 10:15:45,004 DEBUG [RS:1;jenkins-hbase9:39405] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:15:45,004 INFO [RS:1;jenkins-hbase9:39405] regionserver.LeaseManager(133): Closed leases 2023-07-14 10:15:45,006 INFO [RS:1;jenkins-hbase9:39405] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 10:15:45,006 INFO [RS:1;jenkins-hbase9:39405] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 10:15:45,006 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 10:15:45,006 INFO [RS:1;jenkins-hbase9:39405] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 10:15:45,006 INFO [RS:1;jenkins-hbase9:39405] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 10:15:45,011 INFO [RS:1;jenkins-hbase9:39405] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39405 2023-07-14 10:15:45,013 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 10:15:45,019 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:15:45,019 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:15:45,019 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 10:15:45,019 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39405,1689329547044 2023-07-14 10:15:45,019 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 10:15:45,019 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 10:15:45,025 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 10:15:45,032 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,39405,1689329547044] 2023-07-14 10:15:45,034 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,39405,1689329547044; numProcessing=1 2023-07-14 10:15:45,036 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,39405,1689329547044 already deleted, retry=false 2023-07-14 10:15:45,036 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,39405,1689329547044 expired; onlineServers=2 2023-07-14 10:15:45,046 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 10:15:45,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c/.tmp/l/c62710ce22724b85b11fa068a6034606 2023-07-14 10:15:45,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93/.tmp/info/1b016df772104c14af2f40c571404751 2023-07-14 10:15:45,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c62710ce22724b85b11fa068a6034606 2023-07-14 10:15:45,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c/.tmp/l/c62710ce22724b85b11fa068a6034606 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c/l/c62710ce22724b85b11fa068a6034606 2023-07-14 10:15:45,085 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/.tmp/info/e43b62f4471d4e2f9787046186b9b485 2023-07-14 10:15:45,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93/.tmp/info/1b016df772104c14af2f40c571404751 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93/info/1b016df772104c14af2f40c571404751 2023-07-14 10:15:45,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c62710ce22724b85b11fa068a6034606 2023-07-14 10:15:45,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c/l/c62710ce22724b85b11fa068a6034606, entries=7, sequenceid=18, filesize=5.2 K 2023-07-14 10:15:45,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 2d522901cedf9b58bda29b84a423cc3c in 127ms, sequenceid=18, compaction requested=false 2023-07-14 10:15:45,097 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e43b62f4471d4e2f9787046186b9b485 2023-07-14 10:15:45,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93/info/1b016df772104c14af2f40c571404751, entries=2, sequenceid=6, filesize=4.8 K 2023-07-14 10:15:45,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3a1db46edb9b173bb9b26f17faccad93 in 139ms, sequenceid=6, compaction requested=false 2023-07-14 10:15:45,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/acl/2d522901cedf9b58bda29b84a423cc3c/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-14 10:15:45,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:45,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:15:45,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2d522901cedf9b58bda29b84a423cc3c: 2023-07-14 10:15:45,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689329551362.2d522901cedf9b58bda29b84a423cc3c. 2023-07-14 10:15:45,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/namespace/3a1db46edb9b173bb9b26f17faccad93/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 10:15:45,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:45,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:15:45,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3a1db46edb9b173bb9b26f17faccad93: 2023-07-14 10:15:45,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689329550360.3a1db46edb9b173bb9b26f17faccad93. 2023-07-14 10:15:45,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/.tmp/rep_barrier/c60819ba2efb41f5a5945ffff9bf67c1 2023-07-14 10:15:45,135 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 10:15:45,135 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:39405-0x1016343f0830002, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 10:15:45,135 INFO [RS:1;jenkins-hbase9:39405] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,39405,1689329547044; zookeeper connection closed. 2023-07-14 10:15:45,138 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7485c538] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7485c538 2023-07-14 10:15:45,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c60819ba2efb41f5a5945ffff9bf67c1 2023-07-14 10:15:45,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/.tmp/table/b7ecf658ea4a42c188a979176acfbbbc 2023-07-14 10:15:45,166 INFO [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,43497,1689329547088; all regions closed. 2023-07-14 10:15:45,166 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7ecf658ea4a42c188a979176acfbbbc 2023-07-14 10:15:45,167 DEBUG [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 10:15:45,167 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/.tmp/info/e43b62f4471d4e2f9787046186b9b485 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/info/e43b62f4471d4e2f9787046186b9b485 2023-07-14 10:15:45,176 DEBUG [RS:2;jenkins-hbase9:43497] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/oldWALs 2023-07-14 10:15:45,176 INFO [RS:2;jenkins-hbase9:43497] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C43497%2C1689329547088:(num 1689329549619) 2023-07-14 10:15:45,176 DEBUG [RS:2;jenkins-hbase9:43497] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:15:45,176 INFO [RS:2;jenkins-hbase9:43497] regionserver.LeaseManager(133): Closed leases 2023-07-14 10:15:45,176 INFO [RS:2;jenkins-hbase9:43497] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 10:15:45,177 INFO [RS:2;jenkins-hbase9:43497] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 10:15:45,177 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 10:15:45,177 INFO [RS:2;jenkins-hbase9:43497] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 10:15:45,177 INFO [RS:2;jenkins-hbase9:43497] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 10:15:45,179 INFO [RS:2;jenkins-hbase9:43497] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:43497 2023-07-14 10:15:45,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e43b62f4471d4e2f9787046186b9b485 2023-07-14 10:15:45,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/info/e43b62f4471d4e2f9787046186b9b485, entries=48, sequenceid=131, filesize=10.3 K 2023-07-14 10:15:45,180 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:15:45,181 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 10:15:45,181 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,43497,1689329547088 2023-07-14 10:15:45,181 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,43497,1689329547088] 2023-07-14 10:15:45,181 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,43497,1689329547088; numProcessing=2 2023-07-14 10:15:45,182 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/.tmp/rep_barrier/c60819ba2efb41f5a5945ffff9bf67c1 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/rep_barrier/c60819ba2efb41f5a5945ffff9bf67c1 2023-07-14 10:15:45,185 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,43497,1689329547088 already deleted, retry=false 2023-07-14 10:15:45,185 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,43497,1689329547088 expired; onlineServers=1 2023-07-14 10:15:45,188 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c60819ba2efb41f5a5945ffff9bf67c1 2023-07-14 10:15:45,188 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/rep_barrier/c60819ba2efb41f5a5945ffff9bf67c1, entries=13, sequenceid=131, filesize=6.4 K 2023-07-14 10:15:45,189 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/.tmp/table/b7ecf658ea4a42c188a979176acfbbbc as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/table/b7ecf658ea4a42c188a979176acfbbbc 2023-07-14 10:15:45,194 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7ecf658ea4a42c188a979176acfbbbc 2023-07-14 10:15:45,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/table/b7ecf658ea4a42c188a979176acfbbbc, entries=24, sequenceid=131, filesize=6.9 K 2023-07-14 10:15:45,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 228ms, sequenceid=131, compaction requested=false 2023-07-14 10:15:45,213 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-14 10:15:45,213 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:45,214 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 10:15:45,214 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 10:15:45,214 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 10:15:45,214 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-14 10:15:45,283 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 10:15:45,283 INFO [RS:2;jenkins-hbase9:43497] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,43497,1689329547088; zookeeper connection closed. 2023-07-14 10:15:45,283 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:43497-0x1016343f0830003, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 10:15:45,284 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1b3c6e3f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1b3c6e3f 2023-07-14 10:15:45,363 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-14 10:15:45,363 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-14 10:15:45,367 INFO [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,35921,1689329546985; all regions closed. 2023-07-14 10:15:45,378 DEBUG [RS:0;jenkins-hbase9:35921] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/oldWALs 2023-07-14 10:15:45,378 INFO [RS:0;jenkins-hbase9:35921] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35921%2C1689329546985.meta:.meta(num 1689329549897) 2023-07-14 10:15:45,384 DEBUG [RS:0;jenkins-hbase9:35921] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/oldWALs 2023-07-14 10:15:45,384 INFO [RS:0;jenkins-hbase9:35921] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35921%2C1689329546985:(num 1689329549617) 2023-07-14 10:15:45,384 DEBUG [RS:0;jenkins-hbase9:35921] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:15:45,384 INFO [RS:0;jenkins-hbase9:35921] regionserver.LeaseManager(133): Closed leases 2023-07-14 10:15:45,385 INFO [RS:0;jenkins-hbase9:35921] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 10:15:45,385 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 10:15:45,390 INFO [RS:0;jenkins-hbase9:35921] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35921 2023-07-14 10:15:45,392 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 10:15:45,392 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35921,1689329546985 2023-07-14 10:15:45,393 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,35921,1689329546985] 2023-07-14 10:15:45,393 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,35921,1689329546985; numProcessing=3 2023-07-14 10:15:45,394 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,35921,1689329546985 already deleted, retry=false 2023-07-14 10:15:45,394 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,35921,1689329546985 expired; onlineServers=0 2023-07-14 10:15:45,394 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,39063,1689329545379' ***** 2023-07-14 10:15:45,394 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-14 10:15:45,394 DEBUG [M:0;jenkins-hbase9:39063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15f0646b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 10:15:45,394 INFO [M:0;jenkins-hbase9:39063] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,39063,1689329545379 2023-07-14 10:15:45,394 INFO [M:0;jenkins-hbase9:39063] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,39063,1689329545379; all regions closed. 2023-07-14 10:15:45,394 DEBUG [M:0;jenkins-hbase9:39063] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 10:15:45,395 DEBUG [M:0;jenkins-hbase9:39063] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-14 10:15:45,395 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-14 10:15:45,395 DEBUG [M:0;jenkins-hbase9:39063] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-14 10:15:45,395 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689329548962] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689329548962,5,FailOnTimeoutGroup] 2023-07-14 10:15:45,395 INFO [M:0;jenkins-hbase9:39063] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-14 10:15:45,395 INFO [M:0;jenkins-hbase9:39063] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-14 10:15:45,395 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689329548955] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689329548955,5,FailOnTimeoutGroup] 2023-07-14 10:15:45,395 INFO [M:0;jenkins-hbase9:39063] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-14 10:15:45,395 DEBUG [M:0;jenkins-hbase9:39063] master.HMaster(1512): Stopping service threads 2023-07-14 10:15:45,396 INFO [M:0;jenkins-hbase9:39063] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-14 10:15:45,396 ERROR [M:0;jenkins-hbase9:39063] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-26,5,PEWorkerGroup] Thread[HFileArchiver-27,5,PEWorkerGroup] 2023-07-14 10:15:45,397 INFO [M:0;jenkins-hbase9:39063] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-14 10:15:45,397 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-14 10:15:45,399 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-14 10:15:45,399 DEBUG [M:0;jenkins-hbase9:39063] zookeeper.ZKUtil(398): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-14 10:15:45,399 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 10:15:45,399 WARN [M:0;jenkins-hbase9:39063] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-14 10:15:45,399 INFO [M:0;jenkins-hbase9:39063] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-14 10:15:45,399 INFO [M:0;jenkins-hbase9:39063] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-14 10:15:45,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 10:15:45,400 DEBUG [M:0;jenkins-hbase9:39063] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 10:15:45,400 INFO [M:0;jenkins-hbase9:39063] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 10:15:45,400 DEBUG [M:0;jenkins-hbase9:39063] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 10:15:45,400 DEBUG [M:0;jenkins-hbase9:39063] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 10:15:45,400 DEBUG [M:0;jenkins-hbase9:39063] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 10:15:45,400 INFO [M:0;jenkins-hbase9:39063] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.39 KB heapSize=449.61 KB 2023-07-14 10:15:45,426 INFO [M:0;jenkins-hbase9:39063] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.39 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/591b9ee98bac42898083e97a3c212f51 2023-07-14 10:15:45,430 INFO [M:0;jenkins-hbase9:39063] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 591b9ee98bac42898083e97a3c212f51 2023-07-14 10:15:45,431 DEBUG [M:0;jenkins-hbase9:39063] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/591b9ee98bac42898083e97a3c212f51 as hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/591b9ee98bac42898083e97a3c212f51 2023-07-14 10:15:45,436 INFO [M:0;jenkins-hbase9:39063] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 591b9ee98bac42898083e97a3c212f51 2023-07-14 10:15:45,436 INFO [M:0;jenkins-hbase9:39063] regionserver.HStore(1080): Added hdfs://localhost:36399/user/jenkins/test-data/c1bdbaef-8461-0acb-60a8-05117df0c66a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/591b9ee98bac42898083e97a3c212f51, entries=119, sequenceid=899, filesize=28.4 K 2023-07-14 10:15:45,437 INFO [M:0;jenkins-hbase9:39063] regionserver.HRegion(2948): Finished flush of dataSize ~373.39 KB/382347, heapSize ~449.59 KB/460384, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 37ms, sequenceid=899, compaction requested=false 2023-07-14 10:15:45,439 INFO [M:0;jenkins-hbase9:39063] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 10:15:45,439 DEBUG [M:0;jenkins-hbase9:39063] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 10:15:45,443 INFO [M:0;jenkins-hbase9:39063] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-14 10:15:45,443 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 10:15:45,444 INFO [M:0;jenkins-hbase9:39063] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39063 2023-07-14 10:15:45,445 DEBUG [M:0;jenkins-hbase9:39063] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,39063,1689329545379 already deleted, retry=false 2023-07-14 10:15:45,494 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 10:15:45,494 INFO [RS:0;jenkins-hbase9:35921] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,35921,1689329546985; zookeeper connection closed. 2023-07-14 10:15:45,494 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): regionserver:35921-0x1016343f0830001, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 10:15:45,494 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1dcccb4d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1dcccb4d 2023-07-14 10:15:45,494 INFO [Listener at jenkins-hbase9.apache.org/39497] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-14 10:15:45,590 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:45,590 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 10:15:45,591 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:45,591 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 10:15:45,591 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 10:15:45,594 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 10:15:45,594 DEBUG [Listener at localhost/38773-EventThread] zookeeper.ZKWatcher(600): master:39063-0x1016343f0830000, quorum=127.0.0.1:60034, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 10:15:45,594 INFO [M:0;jenkins-hbase9:39063] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,39063,1689329545379; zookeeper connection closed. 2023-07-14 10:15:45,597 WARN [Listener at jenkins-hbase9.apache.org/39497] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 10:15:45,610 INFO [Listener at jenkins-hbase9.apache.org/39497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 10:15:45,715 WARN [BP-1393345786-172.31.2.10-1689329540929 heartbeating to localhost/127.0.0.1:36399] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 10:15:45,715 WARN [BP-1393345786-172.31.2.10-1689329540929 heartbeating to localhost/127.0.0.1:36399] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1393345786-172.31.2.10-1689329540929 (Datanode Uuid 077119fc-a067-4a38-b368-113fe2f2b71e) service to localhost/127.0.0.1:36399 2023-07-14 10:15:45,718 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data5/current/BP-1393345786-172.31.2.10-1689329540929] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 10:15:45,719 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data6/current/BP-1393345786-172.31.2.10-1689329540929] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 10:15:45,721 WARN [Listener at jenkins-hbase9.apache.org/39497] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 10:15:45,724 INFO [Listener at jenkins-hbase9.apache.org/39497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 10:15:45,828 WARN [BP-1393345786-172.31.2.10-1689329540929 heartbeating to localhost/127.0.0.1:36399] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 10:15:45,828 WARN [BP-1393345786-172.31.2.10-1689329540929 heartbeating to localhost/127.0.0.1:36399] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1393345786-172.31.2.10-1689329540929 (Datanode Uuid d6c0e443-8725-46f9-bddd-c83776138253) service to localhost/127.0.0.1:36399 2023-07-14 10:15:45,829 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data3/current/BP-1393345786-172.31.2.10-1689329540929] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 10:15:45,829 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data4/current/BP-1393345786-172.31.2.10-1689329540929] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 10:15:45,830 WARN [Listener at jenkins-hbase9.apache.org/39497] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 10:15:45,837 INFO [Listener at jenkins-hbase9.apache.org/39497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 10:15:45,940 WARN [BP-1393345786-172.31.2.10-1689329540929 heartbeating to localhost/127.0.0.1:36399] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 10:15:45,940 WARN [BP-1393345786-172.31.2.10-1689329540929 heartbeating to localhost/127.0.0.1:36399] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1393345786-172.31.2.10-1689329540929 (Datanode Uuid 12c41ce3-9b13-4dd1-81df-9d4389cf40c9) service to localhost/127.0.0.1:36399 2023-07-14 10:15:45,941 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data1/current/BP-1393345786-172.31.2.10-1689329540929] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 10:15:45,941 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d07d99f6-6462-c9eb-b2c3-8705754df0ed/cluster_a58363f8-3527-5dec-4123-6dc4092d3693/dfs/data/data2/current/BP-1393345786-172.31.2.10-1689329540929] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 10:15:45,979 INFO [Listener at jenkins-hbase9.apache.org/39497] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 10:15:46,108 INFO [Listener at jenkins-hbase9.apache.org/39497] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-14 10:15:46,203 INFO [Listener at jenkins-hbase9.apache.org/39497] hbase.HBaseTestingUtility(1293): Minicluster is down