2023-10-06 15:59:11,578 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-06 15:59:11,800 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49 2023-10-06 15:59:11,800 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-06 15:59:11,801 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-06 15:59:11,836 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-06 15:59:12,053 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-06 15:59:12,054 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2, deleteOnExit=true 2023-10-06 15:59:12,054 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-06 15:59:12,054 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/test.cache.data in system properties and HBase conf 2023-10-06 15:59:12,055 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/hadoop.tmp.dir in system properties and HBase conf 2023-10-06 15:59:12,055 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/hadoop.log.dir in system properties and HBase conf 2023-10-06 15:59:12,056 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-06 15:59:12,056 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-06 15:59:12,056 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-06 15:59:12,336 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-06 15:59:12,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-06 15:59:12,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-06 15:59:12,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-06 15:59:12,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 15:59:12,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-06 15:59:12,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-06 15:59:12,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 15:59:12,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 15:59:12,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-06 15:59:12,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/nfs.dump.dir in system properties and HBase conf 2023-10-06 15:59:12,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/java.io.tmpdir in system properties and HBase conf 2023-10-06 15:59:12,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 15:59:12,345 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-06 15:59:12,345 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-06 15:59:12,827 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-06 15:59:12,831 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-06 15:59:13,091 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-06 15:59:13,242 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-06 15:59:13,260 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 15:59:13,299 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 15:59:13,330 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/java.io.tmpdir/Jetty_localhost_38527_hdfs____.dq5rxd/webapp 2023-10-06 15:59:13,455 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38527 2023-10-06 15:59:13,502 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-06 15:59:13,502 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-06 15:59:13,922 WARN [Listener at localhost/34141] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 15:59:14,002 WARN [Listener at localhost/34141] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-06 15:59:14,021 WARN [Listener at localhost/34141] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 15:59:14,028 INFO [Listener at localhost/34141] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 15:59:14,035 INFO [Listener at localhost/34141] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/java.io.tmpdir/Jetty_localhost_46599_datanode____.vs2ibq/webapp 2023-10-06 15:59:14,160 INFO [Listener at localhost/34141] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46599 2023-10-06 15:59:14,546 WARN [Listener at localhost/40031] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 15:59:14,560 WARN [Listener at localhost/40031] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-06 15:59:14,563 WARN [Listener at localhost/40031] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 15:59:14,566 INFO [Listener at localhost/40031] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 15:59:14,572 INFO [Listener at localhost/40031] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/java.io.tmpdir/Jetty_localhost_36597_datanode____qkopmf/webapp 2023-10-06 15:59:14,668 INFO [Listener at localhost/40031] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36597 2023-10-06 15:59:14,676 WARN [Listener at localhost/44889] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 15:59:14,690 WARN [Listener at localhost/44889] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-06 15:59:14,694 WARN [Listener at localhost/44889] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 15:59:14,696 INFO [Listener at localhost/44889] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 15:59:14,702 INFO [Listener at localhost/44889] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/java.io.tmpdir/Jetty_localhost_40305_datanode____.7cu4d9/webapp 2023-10-06 15:59:14,815 INFO [Listener at localhost/44889] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40305 2023-10-06 15:59:14,831 WARN [Listener at localhost/36163] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-06 15:59:15,009 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71aa86437237e087: Processing first storage report for DS-38602645-951f-40e5-a599-0824f129aff7 from datanode 4f14dbc4-ee2f-4668-8971-4da1685c7bb0 2023-10-06 15:59:15,010 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71aa86437237e087: from storage DS-38602645-951f-40e5-a599-0824f129aff7 node DatanodeRegistration(127.0.0.1:34015, datanodeUuid=4f14dbc4-ee2f-4668-8971-4da1685c7bb0, infoPort=39187, infoSecurePort=0, ipcPort=36163, storageInfo=lv=-57;cid=testClusterID;nsid=2113499530;c=1696607952900), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-06 15:59:15,011 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x568edde1884a2839: Processing first storage report for DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af from datanode f32acbac-f466-4e80-b785-c97900bf7495 2023-10-06 15:59:15,011 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x568edde1884a2839: from storage DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af node DatanodeRegistration(127.0.0.1:33809, datanodeUuid=f32acbac-f466-4e80-b785-c97900bf7495, infoPort=43169, infoSecurePort=0, ipcPort=44889, storageInfo=lv=-57;cid=testClusterID;nsid=2113499530;c=1696607952900), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 15:59:15,011 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x34c9114e8ce1294c: Processing first storage report for DS-6b2037de-b3cd-4d44-beef-2395067e0a08 from datanode 831954e8-7f85-425c-9257-95272c47a4cb 2023-10-06 15:59:15,011 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x34c9114e8ce1294c: from storage DS-6b2037de-b3cd-4d44-beef-2395067e0a08 node DatanodeRegistration(127.0.0.1:33237, datanodeUuid=831954e8-7f85-425c-9257-95272c47a4cb, infoPort=41667, infoSecurePort=0, ipcPort=40031, storageInfo=lv=-57;cid=testClusterID;nsid=2113499530;c=1696607952900), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 15:59:15,011 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71aa86437237e087: Processing first storage report for DS-f8355a24-d5f7-410c-81c4-c40b1005ba0a from datanode 4f14dbc4-ee2f-4668-8971-4da1685c7bb0 2023-10-06 15:59:15,011 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71aa86437237e087: from storage DS-f8355a24-d5f7-410c-81c4-c40b1005ba0a node DatanodeRegistration(127.0.0.1:34015, datanodeUuid=4f14dbc4-ee2f-4668-8971-4da1685c7bb0, infoPort=39187, infoSecurePort=0, ipcPort=36163, storageInfo=lv=-57;cid=testClusterID;nsid=2113499530;c=1696607952900), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 15:59:15,011 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x568edde1884a2839: Processing first storage report for DS-213ad6b8-1088-4d1b-8279-b1f136e1ed58 from datanode f32acbac-f466-4e80-b785-c97900bf7495 2023-10-06 15:59:15,011 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x568edde1884a2839: from storage DS-213ad6b8-1088-4d1b-8279-b1f136e1ed58 node DatanodeRegistration(127.0.0.1:33809, datanodeUuid=f32acbac-f466-4e80-b785-c97900bf7495, infoPort=43169, infoSecurePort=0, ipcPort=44889, storageInfo=lv=-57;cid=testClusterID;nsid=2113499530;c=1696607952900), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 15:59:15,012 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x34c9114e8ce1294c: Processing first storage report for DS-848e379e-3ad1-48b5-95ff-db814bb1459d from datanode 831954e8-7f85-425c-9257-95272c47a4cb 2023-10-06 15:59:15,012 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x34c9114e8ce1294c: from storage DS-848e379e-3ad1-48b5-95ff-db814bb1459d node DatanodeRegistration(127.0.0.1:33237, datanodeUuid=831954e8-7f85-425c-9257-95272c47a4cb, infoPort=41667, infoSecurePort=0, ipcPort=40031, storageInfo=lv=-57;cid=testClusterID;nsid=2113499530;c=1696607952900), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-06 15:59:15,193 DEBUG [Listener at localhost/36163] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49 2023-10-06 15:59:15,272 INFO [Listener at localhost/36163] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/zookeeper_0, clientPort=55741, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-06 15:59:15,289 INFO [Listener at localhost/36163] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55741 2023-10-06 15:59:15,301 INFO [Listener at localhost/36163] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 15:59:15,303 INFO [Listener at localhost/36163] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 15:59:15,970 INFO [Listener at localhost/36163] util.FSUtils(471): Created version file at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca with version=8 2023-10-06 15:59:15,970 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/hbase-staging 2023-10-06 15:59:16,318 INFO [Listener at localhost/36163] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-06 15:59:16,865 INFO [Listener at localhost/36163] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-06 15:59:16,898 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:16,899 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:16,899 INFO [Listener at localhost/36163] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 15:59:16,899 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:16,899 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 15:59:17,046 INFO [Listener at localhost/36163] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 15:59:17,125 DEBUG [Listener at localhost/36163] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-06 15:59:17,218 INFO [Listener at localhost/36163] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45793 2023-10-06 15:59:17,231 INFO [Listener at localhost/36163] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 15:59:17,234 INFO [Listener at localhost/36163] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 15:59:17,257 INFO [Listener at localhost/36163] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45793 connecting to ZooKeeper ensemble=127.0.0.1:55741 2023-10-06 15:59:17,302 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:457930x0, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 15:59:17,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45793-0x1011c7620dc0000 connected 2023-10-06 15:59:17,330 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 15:59:17,331 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 15:59:17,344 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 15:59:17,352 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45793 2023-10-06 15:59:17,352 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45793 2023-10-06 15:59:17,352 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45793 2023-10-06 15:59:17,353 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45793 2023-10-06 15:59:17,353 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45793 2023-10-06 15:59:17,359 INFO [Listener at localhost/36163] master.HMaster(444): hbase.rootdir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca, hbase.cluster.distributed=false 2023-10-06 15:59:17,422 INFO [Listener at localhost/36163] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-06 15:59:17,423 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:17,423 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:17,423 INFO [Listener at localhost/36163] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 15:59:17,423 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:17,423 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 15:59:17,428 INFO [Listener at localhost/36163] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 15:59:17,432 INFO [Listener at localhost/36163] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41607 2023-10-06 15:59:17,434 INFO [Listener at localhost/36163] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-06 15:59:17,441 INFO [Listener at localhost/36163] mob.MobFileCache(125): MobFileCache disabled 2023-10-06 15:59:17,443 INFO [Listener at localhost/36163] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 15:59:17,445 INFO [Listener at localhost/36163] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 15:59:17,448 INFO [Listener at localhost/36163] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41607 connecting to ZooKeeper ensemble=127.0.0.1:55741 2023-10-06 15:59:17,451 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:416070x0, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 15:59:17,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41607-0x1011c7620dc0001 connected 2023-10-06 15:59:17,453 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 15:59:17,454 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 15:59:17,455 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 15:59:17,455 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41607 2023-10-06 15:59:17,456 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41607 2023-10-06 15:59:17,456 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41607 2023-10-06 15:59:17,457 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41607 2023-10-06 15:59:17,457 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41607 2023-10-06 15:59:17,470 INFO [Listener at localhost/36163] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-06 15:59:17,470 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:17,470 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:17,470 INFO [Listener at localhost/36163] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 15:59:17,471 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:17,471 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 15:59:17,471 INFO [Listener at localhost/36163] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 15:59:17,474 INFO [Listener at localhost/36163] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32989 2023-10-06 15:59:17,474 INFO [Listener at localhost/36163] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-06 15:59:17,475 INFO [Listener at localhost/36163] mob.MobFileCache(125): MobFileCache disabled 2023-10-06 15:59:17,476 INFO [Listener at localhost/36163] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 15:59:17,478 INFO [Listener at localhost/36163] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 15:59:17,482 INFO [Listener at localhost/36163] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32989 connecting to ZooKeeper ensemble=127.0.0.1:55741 2023-10-06 15:59:17,485 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:329890x0, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 15:59:17,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:32989-0x1011c7620dc0002 connected 2023-10-06 15:59:17,486 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 15:59:17,487 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 15:59:17,488 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 15:59:17,488 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32989 2023-10-06 15:59:17,493 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32989 2023-10-06 15:59:17,493 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32989 2023-10-06 15:59:17,494 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32989 2023-10-06 15:59:17,496 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32989 2023-10-06 15:59:17,508 INFO [Listener at localhost/36163] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-06 15:59:17,509 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:17,509 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:17,509 INFO [Listener at localhost/36163] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-06 15:59:17,509 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-06 15:59:17,509 INFO [Listener at localhost/36163] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-06 15:59:17,509 INFO [Listener at localhost/36163] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-06 15:59:17,510 INFO [Listener at localhost/36163] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36069 2023-10-06 15:59:17,511 INFO [Listener at localhost/36163] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-06 15:59:17,511 INFO [Listener at localhost/36163] mob.MobFileCache(125): MobFileCache disabled 2023-10-06 15:59:17,512 INFO [Listener at localhost/36163] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 15:59:17,514 INFO [Listener at localhost/36163] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 15:59:17,515 INFO [Listener at localhost/36163] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36069 connecting to ZooKeeper ensemble=127.0.0.1:55741 2023-10-06 15:59:17,519 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:360690x0, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-06 15:59:17,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36069-0x1011c7620dc0003 connected 2023-10-06 15:59:17,521 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 15:59:17,521 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 15:59:17,522 DEBUG [Listener at localhost/36163] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-06 15:59:17,523 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36069 2023-10-06 15:59:17,525 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36069 2023-10-06 15:59:17,529 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36069 2023-10-06 15:59:17,529 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36069 2023-10-06 15:59:17,530 DEBUG [Listener at localhost/36163] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36069 2023-10-06 15:59:17,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45793,1696607956151 2023-10-06 15:59:17,545 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-06 15:59:17,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45793,1696607956151 2023-10-06 15:59:17,568 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 15:59:17,568 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 15:59:17,568 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 15:59:17,568 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-06 15:59:17,569 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 15:59:17,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-06 15:59:17,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45793,1696607956151 from backup master directory 2023-10-06 15:59:17,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-06 15:59:17,575 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45793,1696607956151 2023-10-06 15:59:17,575 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-06 15:59:17,576 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 15:59:17,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45793,1696607956151 2023-10-06 15:59:17,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-06 15:59:17,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-06 15:59:17,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/hbase.id with ID: a801e41d-7f49-4771-b205-96126b9792c5 2023-10-06 15:59:17,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-06 15:59:17,729 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 15:59:17,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3a8e6b12 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:17,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77ede1a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:17,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-06 15:59:17,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-06 15:59:17,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-06 15:59:17,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-06 15:59:17,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-06 15:59:17,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-06 15:59:17,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 15:59:17,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/data/master/store-tmp 2023-10-06 15:59:17,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:17,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-06 15:59:17,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 15:59:17,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 15:59:17,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-06 15:59:17,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 15:59:17,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 15:59:17,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-06 15:59:17,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/WALs/jenkins-hbase4.apache.org,45793,1696607956151 2023-10-06 15:59:17,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45793%2C1696607956151, suffix=, logDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/WALs/jenkins-hbase4.apache.org,45793,1696607956151, archiveDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/oldWALs, maxLogs=10 2023-10-06 15:59:18,026 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33237,DS-6b2037de-b3cd-4d44-beef-2395067e0a08,DISK] 2023-10-06 15:59:18,026 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33809,DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af,DISK] 2023-10-06 15:59:18,026 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34015,DS-38602645-951f-40e5-a599-0824f129aff7,DISK] 2023-10-06 15:59:18,035 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-06 15:59:18,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/WALs/jenkins-hbase4.apache.org,45793,1696607956151/jenkins-hbase4.apache.org%2C45793%2C1696607956151.1696607957973 2023-10-06 15:59:18,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33237,DS-6b2037de-b3cd-4d44-beef-2395067e0a08,DISK], DatanodeInfoWithStorage[127.0.0.1:34015,DS-38602645-951f-40e5-a599-0824f129aff7,DISK], DatanodeInfoWithStorage[127.0.0.1:33809,DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af,DISK]] 2023-10-06 15:59:18,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-06 15:59:18,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:18,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-06 15:59:18,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-06 15:59:18,187 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-06 15:59:18,195 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-06 15:59:18,232 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-06 15:59:18,245 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:18,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-06 15:59:18,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-06 15:59:18,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-06 15:59:18,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 15:59:18,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67736979, jitterRate=0.00935964286327362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 15:59:18,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-06 15:59:18,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-06 15:59:18,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-06 15:59:18,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-06 15:59:18,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-06 15:59:18,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-06 15:59:18,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-10-06 15:59:18,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-06 15:59:18,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-06 15:59:18,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-06 15:59:18,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-06 15:59:18,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-06 15:59:18,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-06 15:59:18,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-06 15:59:18,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-06 15:59:18,416 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 15:59:18,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-06 15:59:18,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-06 15:59:18,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-06 15:59:18,436 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 15:59:18,436 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 15:59:18,436 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 15:59:18,436 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-06 15:59:18,436 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 15:59:18,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45793,1696607956151, sessionid=0x1011c7620dc0000, setting cluster-up flag (Was=false) 2023-10-06 15:59:18,455 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 15:59:18,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-06 15:59:18,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45793,1696607956151 2023-10-06 15:59:18,469 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 15:59:18,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-06 15:59:18,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45793,1696607956151 2023-10-06 15:59:18,481 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp 2023-10-06 15:59:18,534 INFO [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(951): ClusterId : a801e41d-7f49-4771-b205-96126b9792c5 2023-10-06 15:59:18,534 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(951): ClusterId : a801e41d-7f49-4771-b205-96126b9792c5 2023-10-06 15:59:18,534 INFO [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(951): ClusterId : a801e41d-7f49-4771-b205-96126b9792c5 2023-10-06 15:59:18,543 DEBUG [RS:2;jenkins-hbase4:36069] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-06 15:59:18,543 DEBUG [RS:1;jenkins-hbase4:32989] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-06 15:59:18,543 DEBUG [RS:0;jenkins-hbase4:41607] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-06 15:59:18,550 DEBUG [RS:0;jenkins-hbase4:41607] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-06 15:59:18,550 DEBUG [RS:1;jenkins-hbase4:32989] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-06 15:59:18,550 DEBUG [RS:2;jenkins-hbase4:36069] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-06 15:59:18,550 DEBUG [RS:1;jenkins-hbase4:32989] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-06 15:59:18,550 DEBUG [RS:0;jenkins-hbase4:41607] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-06 15:59:18,551 DEBUG [RS:2;jenkins-hbase4:36069] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-06 15:59:18,555 DEBUG [RS:2;jenkins-hbase4:36069] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-06 15:59:18,555 DEBUG [RS:0;jenkins-hbase4:41607] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-06 15:59:18,555 DEBUG [RS:1;jenkins-hbase4:32989] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-06 15:59:18,564 DEBUG [RS:1;jenkins-hbase4:32989] zookeeper.ReadOnlyZKClient(139): Connect 0x605b14de to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:18,564 DEBUG [RS:0;jenkins-hbase4:41607] zookeeper.ReadOnlyZKClient(139): Connect 0x4b1d9efd to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:18,564 DEBUG [RS:2;jenkins-hbase4:36069] zookeeper.ReadOnlyZKClient(139): Connect 0x4af6fd2a to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:18,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-06 15:59:18,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:18,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-06 15:59:18,613 DEBUG [RS:0;jenkins-hbase4:41607] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16a7fa0b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:18,614 DEBUG [RS:2;jenkins-hbase4:36069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d8aa483, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:18,614 DEBUG [RS:1;jenkins-hbase4:32989] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@180ca0a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:18,614 DEBUG [RS:0;jenkins-hbase4:41607] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@331a4274, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-06 15:59:18,614 DEBUG [RS:2;jenkins-hbase4:36069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@257ad121, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-06 15:59:18,615 DEBUG [RS:1;jenkins-hbase4:32989] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c621174, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-06 15:59:18,639 DEBUG [RS:2;jenkins-hbase4:36069] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:36069 2023-10-06 15:59:18,640 DEBUG [RS:1;jenkins-hbase4:32989] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:32989 2023-10-06 15:59:18,643 DEBUG [RS:0;jenkins-hbase4:41607] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41607 2023-10-06 15:59:18,644 INFO [RS:1;jenkins-hbase4:32989] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-06 15:59:18,644 INFO [RS:0;jenkins-hbase4:41607] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-06 15:59:18,644 INFO [RS:1;jenkins-hbase4:32989] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-06 15:59:18,644 INFO [RS:2;jenkins-hbase4:36069] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-06 15:59:18,645 INFO [RS:0;jenkins-hbase4:41607] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-06 15:59:18,645 INFO [RS:2;jenkins-hbase4:36069] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-06 15:59:18,645 DEBUG [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-06 15:59:18,645 DEBUG [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-06 15:59:18,645 DEBUG [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-06 15:59:18,646 INFO [RS:1;jenkins-hbase4:32989] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:18,646 INFO [RS:2;jenkins-hbase4:36069] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:18,646 INFO [RS:0;jenkins-hbase4:41607] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:18,646 DEBUG [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(1022): About to register with Master. 2023-10-06 15:59:18,646 DEBUG [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(1022): About to register with Master. 2023-10-06 15:59:18,646 DEBUG [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1022): About to register with Master. 2023-10-06 15:59:18,650 INFO [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45793,1696607956151 with isa=jenkins-hbase4.apache.org/172.31.14.131:32989, startcode=1696607957469 2023-10-06 15:59:18,650 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45793,1696607956151 with isa=jenkins-hbase4.apache.org/172.31.14.131:41607, startcode=1696607957421 2023-10-06 15:59:18,650 INFO [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45793,1696607956151 with isa=jenkins-hbase4.apache.org/172.31.14.131:36069, startcode=1696607957508 2023-10-06 15:59:18,670 DEBUG [RS:0;jenkins-hbase4:41607] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-06 15:59:18,670 DEBUG [RS:1;jenkins-hbase4:32989] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-06 15:59:18,670 DEBUG [RS:2;jenkins-hbase4:36069] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-06 15:59:18,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-06 15:59:18,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-06 15:59:18,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-06 15:59:18,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-06 15:59:18,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-06 15:59:18,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-06 15:59:18,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-06 15:59:18,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696607988713 2023-10-06 15:59:18,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-06 15:59:18,718 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-06 15:59:18,719 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-06 15:59:18,725 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-06 15:59:18,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-06 15:59:18,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-06 15:59:18,738 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42187, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-06 15:59:18,738 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41225, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-06 15:59:18,738 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44607, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-06 15:59:18,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-06 15:59:18,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-06 15:59:18,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-06 15:59:18,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-06 15:59:18,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-06 15:59:18,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-06 15:59:18,749 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45793] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-06 15:59:18,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-06 15:59:18,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-06 15:59:18,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696607958755,5,FailOnTimeoutGroup] 2023-10-06 15:59:18,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696607958757,5,FailOnTimeoutGroup] 2023-10-06 15:59:18,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-06 15:59:18,758 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45793] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-06 15:59:18,759 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45793] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-06 15:59:18,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,779 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-06 15:59:18,780 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-06 15:59:18,780 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 15:59:18,788 DEBUG [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(2830): Master is not running yet 2023-10-06 15:59:18,788 DEBUG [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(2830): Master is not running yet 2023-10-06 15:59:18,788 DEBUG [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(2830): Master is not running yet 2023-10-06 15:59:18,789 WARN [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-06 15:59:18,789 WARN [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-06 15:59:18,789 WARN [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-06 15:59:18,806 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:18,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-06 15:59:18,811 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/info 2023-10-06 15:59:18,811 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-06 15:59:18,812 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:18,812 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-06 15:59:18,815 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/rep_barrier 2023-10-06 15:59:18,815 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-06 15:59:18,816 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:18,816 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-06 15:59:18,818 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/table 2023-10-06 15:59:18,818 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-06 15:59:18,819 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:18,820 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740 2023-10-06 15:59:18,821 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740 2023-10-06 15:59:18,824 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-06 15:59:18,826 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-06 15:59:18,830 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 15:59:18,831 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74246377, jitterRate=0.10635723173618317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-06 15:59:18,831 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-06 15:59:18,831 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-06 15:59:18,831 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-06 15:59:18,831 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-06 15:59:18,831 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-06 15:59:18,831 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-06 15:59:18,833 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-06 15:59:18,833 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-06 15:59:18,838 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-06 15:59:18,838 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-06 15:59:18,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-06 15:59:18,859 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-06 15:59:18,863 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-06 15:59:18,890 INFO [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45793,1696607956151 with isa=jenkins-hbase4.apache.org/172.31.14.131:36069, startcode=1696607957508 2023-10-06 15:59:18,890 INFO [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45793,1696607956151 with isa=jenkins-hbase4.apache.org/172.31.14.131:32989, startcode=1696607957469 2023-10-06 15:59:18,890 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45793,1696607956151 with isa=jenkins-hbase4.apache.org/172.31.14.131:41607, startcode=1696607957421 2023-10-06 15:59:18,896 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45793] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:18,901 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45793] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:18,902 DEBUG [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 15:59:18,902 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45793] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:18,902 DEBUG [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34141 2023-10-06 15:59:18,902 DEBUG [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-06 15:59:18,903 DEBUG [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 15:59:18,903 DEBUG [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34141 2023-10-06 15:59:18,903 DEBUG [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-06 15:59:18,903 DEBUG [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 15:59:18,903 DEBUG [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34141 2023-10-06 15:59:18,904 DEBUG [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-06 15:59:18,913 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 15:59:18,914 DEBUG [RS:1;jenkins-hbase4:32989] zookeeper.ZKUtil(162): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:18,914 DEBUG [RS:0;jenkins-hbase4:41607] zookeeper.ZKUtil(162): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:18,914 DEBUG [RS:2;jenkins-hbase4:36069] zookeeper.ZKUtil(162): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:18,914 WARN [RS:0;jenkins-hbase4:41607] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 15:59:18,914 WARN [RS:1;jenkins-hbase4:32989] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 15:59:18,915 INFO [RS:0;jenkins-hbase4:41607] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 15:59:18,915 INFO [RS:1;jenkins-hbase4:32989] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 15:59:18,914 WARN [RS:2;jenkins-hbase4:36069] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-06 15:59:18,915 DEBUG [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/WALs/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:18,915 DEBUG [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/WALs/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:18,915 INFO [RS:2;jenkins-hbase4:36069] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 15:59:18,916 DEBUG [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/WALs/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:18,916 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41607,1696607957421] 2023-10-06 15:59:18,916 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36069,1696607957508] 2023-10-06 15:59:18,916 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32989,1696607957469] 2023-10-06 15:59:18,930 DEBUG [RS:1;jenkins-hbase4:32989] zookeeper.ZKUtil(162): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:18,930 DEBUG [RS:0;jenkins-hbase4:41607] zookeeper.ZKUtil(162): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:18,930 DEBUG [RS:2;jenkins-hbase4:36069] zookeeper.ZKUtil(162): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:18,930 DEBUG [RS:1;jenkins-hbase4:32989] zookeeper.ZKUtil(162): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:18,931 DEBUG [RS:0;jenkins-hbase4:41607] zookeeper.ZKUtil(162): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:18,931 DEBUG [RS:2;jenkins-hbase4:36069] zookeeper.ZKUtil(162): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:18,931 DEBUG [RS:1;jenkins-hbase4:32989] zookeeper.ZKUtil(162): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:18,931 DEBUG [RS:2;jenkins-hbase4:36069] zookeeper.ZKUtil(162): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:18,931 DEBUG [RS:0;jenkins-hbase4:41607] zookeeper.ZKUtil(162): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:18,943 DEBUG [RS:2;jenkins-hbase4:36069] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-06 15:59:18,943 DEBUG [RS:1;jenkins-hbase4:32989] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-06 15:59:18,943 DEBUG [RS:0;jenkins-hbase4:41607] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-06 15:59:18,954 INFO [RS:1;jenkins-hbase4:32989] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-06 15:59:18,954 INFO [RS:0;jenkins-hbase4:41607] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-06 15:59:18,954 INFO [RS:2;jenkins-hbase4:36069] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-06 15:59:18,978 INFO [RS:2;jenkins-hbase4:36069] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-06 15:59:18,978 INFO [RS:1;jenkins-hbase4:32989] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-06 15:59:18,978 INFO [RS:0;jenkins-hbase4:41607] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-06 15:59:18,982 INFO [RS:2;jenkins-hbase4:36069] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-06 15:59:18,982 INFO [RS:1;jenkins-hbase4:32989] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-06 15:59:18,982 INFO [RS:0;jenkins-hbase4:41607] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-06 15:59:18,983 INFO [RS:1;jenkins-hbase4:32989] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,983 INFO [RS:2;jenkins-hbase4:36069] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,983 INFO [RS:0;jenkins-hbase4:41607] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,984 INFO [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-06 15:59:18,984 INFO [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-06 15:59:18,984 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-06 15:59:18,992 INFO [RS:1;jenkins-hbase4:32989] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,992 INFO [RS:2;jenkins-hbase4:36069] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,992 INFO [RS:0;jenkins-hbase4:41607] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,992 DEBUG [RS:1;jenkins-hbase4:32989] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,992 DEBUG [RS:2;jenkins-hbase4:36069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:1;jenkins-hbase4:32989] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:0;jenkins-hbase4:41607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:1;jenkins-hbase4:32989] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:0;jenkins-hbase4:41607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:1;jenkins-hbase4:32989] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:0;jenkins-hbase4:41607] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:1;jenkins-hbase4:32989] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:0;jenkins-hbase4:41607] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:1;jenkins-hbase4:32989] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-06 15:59:18,993 DEBUG [RS:0;jenkins-hbase4:41607] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:1;jenkins-hbase4:32989] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:0;jenkins-hbase4:41607] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-06 15:59:18,993 DEBUG [RS:2;jenkins-hbase4:36069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:0;jenkins-hbase4:41607] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,993 DEBUG [RS:1;jenkins-hbase4:32989] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,994 DEBUG [RS:0;jenkins-hbase4:41607] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,994 DEBUG [RS:1;jenkins-hbase4:32989] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,994 DEBUG [RS:0;jenkins-hbase4:41607] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,994 DEBUG [RS:1;jenkins-hbase4:32989] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,994 DEBUG [RS:2;jenkins-hbase4:36069] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,994 DEBUG [RS:0;jenkins-hbase4:41607] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,994 DEBUG [RS:2;jenkins-hbase4:36069] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,994 DEBUG [RS:2;jenkins-hbase4:36069] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,995 DEBUG [RS:2;jenkins-hbase4:36069] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-06 15:59:18,995 DEBUG [RS:2;jenkins-hbase4:36069] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,995 DEBUG [RS:2;jenkins-hbase4:36069] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,995 DEBUG [RS:2;jenkins-hbase4:36069] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,995 DEBUG [RS:2;jenkins-hbase4:36069] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-06 15:59:18,997 INFO [RS:0;jenkins-hbase4:41607] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,997 INFO [RS:0;jenkins-hbase4:41607] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:18,997 INFO [RS:0;jenkins-hbase4:41607] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,001 INFO [RS:1;jenkins-hbase4:32989] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,001 INFO [RS:1;jenkins-hbase4:32989] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,001 INFO [RS:2;jenkins-hbase4:36069] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,002 INFO [RS:1;jenkins-hbase4:32989] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,002 INFO [RS:2;jenkins-hbase4:36069] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,002 INFO [RS:2;jenkins-hbase4:36069] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,015 DEBUG [jenkins-hbase4:45793] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-06 15:59:19,017 INFO [RS:0;jenkins-hbase4:41607] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-06 15:59:19,019 INFO [RS:2;jenkins-hbase4:36069] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-06 15:59:19,019 INFO [RS:1;jenkins-hbase4:32989] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-06 15:59:19,021 DEBUG [jenkins-hbase4:45793] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 15:59:19,021 INFO [RS:0;jenkins-hbase4:41607] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41607,1696607957421-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,021 INFO [RS:1;jenkins-hbase4:32989] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32989,1696607957469-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,021 INFO [RS:2;jenkins-hbase4:36069] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36069,1696607957508-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,028 DEBUG [jenkins-hbase4:45793] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 15:59:19,028 DEBUG [jenkins-hbase4:45793] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 15:59:19,028 DEBUG [jenkins-hbase4:45793] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 15:59:19,028 DEBUG [jenkins-hbase4:45793] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 15:59:19,032 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41607,1696607957421, state=OPENING 2023-10-06 15:59:19,042 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-06 15:59:19,043 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 15:59:19,044 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-06 15:59:19,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 15:59:19,053 INFO [RS:0;jenkins-hbase4:41607] regionserver.Replication(203): jenkins-hbase4.apache.org,41607,1696607957421 started 2023-10-06 15:59:19,053 INFO [RS:1;jenkins-hbase4:32989] regionserver.Replication(203): jenkins-hbase4.apache.org,32989,1696607957469 started 2023-10-06 15:59:19,054 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41607,1696607957421, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41607, sessionid=0x1011c7620dc0001 2023-10-06 15:59:19,054 INFO [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,32989,1696607957469, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32989, sessionid=0x1011c7620dc0002 2023-10-06 15:59:19,054 INFO [RS:2;jenkins-hbase4:36069] regionserver.Replication(203): jenkins-hbase4.apache.org,36069,1696607957508 started 2023-10-06 15:59:19,054 DEBUG [RS:1;jenkins-hbase4:32989] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-06 15:59:19,054 DEBUG [RS:0;jenkins-hbase4:41607] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-06 15:59:19,055 DEBUG [RS:1;jenkins-hbase4:32989] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:19,054 INFO [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36069,1696607957508, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36069, sessionid=0x1011c7620dc0003 2023-10-06 15:59:19,055 DEBUG [RS:1;jenkins-hbase4:32989] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32989,1696607957469' 2023-10-06 15:59:19,056 DEBUG [RS:2;jenkins-hbase4:36069] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-06 15:59:19,056 DEBUG [RS:2;jenkins-hbase4:36069] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:19,055 DEBUG [RS:0;jenkins-hbase4:41607] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:19,056 DEBUG [RS:2;jenkins-hbase4:36069] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36069,1696607957508' 2023-10-06 15:59:19,056 DEBUG [RS:1;jenkins-hbase4:32989] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-06 15:59:19,056 DEBUG [RS:2;jenkins-hbase4:36069] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-06 15:59:19,056 DEBUG [RS:0;jenkins-hbase4:41607] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41607,1696607957421' 2023-10-06 15:59:19,057 DEBUG [RS:0;jenkins-hbase4:41607] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-06 15:59:19,057 DEBUG [RS:1;jenkins-hbase4:32989] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-06 15:59:19,057 DEBUG [RS:0;jenkins-hbase4:41607] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-06 15:59:19,057 DEBUG [RS:2;jenkins-hbase4:36069] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-06 15:59:19,058 DEBUG [RS:0;jenkins-hbase4:41607] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-06 15:59:19,058 DEBUG [RS:1;jenkins-hbase4:32989] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-06 15:59:19,058 DEBUG [RS:2;jenkins-hbase4:36069] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-06 15:59:19,058 DEBUG [RS:2;jenkins-hbase4:36069] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-06 15:59:19,058 DEBUG [RS:0;jenkins-hbase4:41607] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-06 15:59:19,058 DEBUG [RS:2;jenkins-hbase4:36069] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:19,058 DEBUG [RS:1;jenkins-hbase4:32989] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-06 15:59:19,059 DEBUG [RS:2;jenkins-hbase4:36069] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36069,1696607957508' 2023-10-06 15:59:19,060 DEBUG [RS:2;jenkins-hbase4:36069] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:19,058 DEBUG [RS:0;jenkins-hbase4:41607] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:19,059 DEBUG [RS:1;jenkins-hbase4:32989] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:19,060 DEBUG [RS:1;jenkins-hbase4:32989] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32989,1696607957469' 2023-10-06 15:59:19,060 DEBUG [RS:0;jenkins-hbase4:41607] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41607,1696607957421' 2023-10-06 15:59:19,060 DEBUG [RS:1;jenkins-hbase4:32989] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:19,060 DEBUG [RS:0;jenkins-hbase4:41607] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:19,060 DEBUG [RS:2;jenkins-hbase4:36069] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:19,061 DEBUG [RS:0;jenkins-hbase4:41607] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:19,061 DEBUG [RS:1;jenkins-hbase4:32989] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:19,061 DEBUG [RS:2;jenkins-hbase4:36069] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-06 15:59:19,061 INFO [RS:2;jenkins-hbase4:36069] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-06 15:59:19,061 INFO [RS:2;jenkins-hbase4:36069] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-06 15:59:19,061 DEBUG [RS:0;jenkins-hbase4:41607] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-06 15:59:19,061 DEBUG [RS:1;jenkins-hbase4:32989] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-06 15:59:19,061 INFO [RS:0;jenkins-hbase4:41607] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-06 15:59:19,063 INFO [RS:1;jenkins-hbase4:32989] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-06 15:59:19,063 INFO [RS:1;jenkins-hbase4:32989] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-06 15:59:19,063 INFO [RS:0;jenkins-hbase4:41607] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-06 15:59:19,176 INFO [RS:1;jenkins-hbase4:32989] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32989%2C1696607957469, suffix=, logDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/WALs/jenkins-hbase4.apache.org,32989,1696607957469, archiveDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/oldWALs, maxLogs=32 2023-10-06 15:59:19,176 INFO [RS:2;jenkins-hbase4:36069] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36069%2C1696607957508, suffix=, logDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/WALs/jenkins-hbase4.apache.org,36069,1696607957508, archiveDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/oldWALs, maxLogs=32 2023-10-06 15:59:19,176 INFO [RS:0;jenkins-hbase4:41607] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41607%2C1696607957421, suffix=, logDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/WALs/jenkins-hbase4.apache.org,41607,1696607957421, archiveDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/oldWALs, maxLogs=32 2023-10-06 15:59:19,206 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33237,DS-6b2037de-b3cd-4d44-beef-2395067e0a08,DISK] 2023-10-06 15:59:19,207 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33809,DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af,DISK] 2023-10-06 15:59:19,210 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33237,DS-6b2037de-b3cd-4d44-beef-2395067e0a08,DISK] 2023-10-06 15:59:19,212 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34015,DS-38602645-951f-40e5-a599-0824f129aff7,DISK] 2023-10-06 15:59:19,213 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33809,DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af,DISK] 2023-10-06 15:59:19,213 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34015,DS-38602645-951f-40e5-a599-0824f129aff7,DISK] 2023-10-06 15:59:19,233 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34015,DS-38602645-951f-40e5-a599-0824f129aff7,DISK] 2023-10-06 15:59:19,233 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33237,DS-6b2037de-b3cd-4d44-beef-2395067e0a08,DISK] 2023-10-06 15:59:19,233 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33809,DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af,DISK] 2023-10-06 15:59:19,240 INFO [RS:0;jenkins-hbase4:41607] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/WALs/jenkins-hbase4.apache.org,41607,1696607957421/jenkins-hbase4.apache.org%2C41607%2C1696607957421.1696607959180 2023-10-06 15:59:19,241 DEBUG [RS:0;jenkins-hbase4:41607] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33237,DS-6b2037de-b3cd-4d44-beef-2395067e0a08,DISK], DatanodeInfoWithStorage[127.0.0.1:34015,DS-38602645-951f-40e5-a599-0824f129aff7,DISK], DatanodeInfoWithStorage[127.0.0.1:33809,DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af,DISK]] 2023-10-06 15:59:19,242 INFO [RS:1;jenkins-hbase4:32989] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/WALs/jenkins-hbase4.apache.org,32989,1696607957469/jenkins-hbase4.apache.org%2C32989%2C1696607957469.1696607959180 2023-10-06 15:59:19,249 DEBUG [RS:1;jenkins-hbase4:32989] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33237,DS-6b2037de-b3cd-4d44-beef-2395067e0a08,DISK], DatanodeInfoWithStorage[127.0.0.1:33809,DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af,DISK], DatanodeInfoWithStorage[127.0.0.1:34015,DS-38602645-951f-40e5-a599-0824f129aff7,DISK]] 2023-10-06 15:59:19,249 INFO [RS:2;jenkins-hbase4:36069] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/WALs/jenkins-hbase4.apache.org,36069,1696607957508/jenkins-hbase4.apache.org%2C36069%2C1696607957508.1696607959181 2023-10-06 15:59:19,250 DEBUG [RS:2;jenkins-hbase4:36069] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33809,DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af,DISK], DatanodeInfoWithStorage[127.0.0.1:33237,DS-6b2037de-b3cd-4d44-beef-2395067e0a08,DISK], DatanodeInfoWithStorage[127.0.0.1:34015,DS-38602645-951f-40e5-a599-0824f129aff7,DISK]] 2023-10-06 15:59:19,267 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:19,270 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 15:59:19,273 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 15:59:19,288 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-06 15:59:19,289 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-06 15:59:19,292 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41607%2C1696607957421.meta, suffix=.meta, logDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/WALs/jenkins-hbase4.apache.org,41607,1696607957421, archiveDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/oldWALs, maxLogs=32 2023-10-06 15:59:19,312 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33809,DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af,DISK] 2023-10-06 15:59:19,312 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34015,DS-38602645-951f-40e5-a599-0824f129aff7,DISK] 2023-10-06 15:59:19,314 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33237,DS-6b2037de-b3cd-4d44-beef-2395067e0a08,DISK] 2023-10-06 15:59:19,319 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/WALs/jenkins-hbase4.apache.org,41607,1696607957421/jenkins-hbase4.apache.org%2C41607%2C1696607957421.meta.1696607959293.meta 2023-10-06 15:59:19,320 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34015,DS-38602645-951f-40e5-a599-0824f129aff7,DISK], DatanodeInfoWithStorage[127.0.0.1:33809,DS-6dc10ffa-8071-46e0-ab49-d038efc8c2af,DISK], DatanodeInfoWithStorage[127.0.0.1:33237,DS-6b2037de-b3cd-4d44-beef-2395067e0a08,DISK]] 2023-10-06 15:59:19,320 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-06 15:59:19,321 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-06 15:59:19,323 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:19,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-06 15:59:19,325 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-06 15:59:19,327 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-06 15:59:19,339 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-06 15:59:19,339 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:19,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-06 15:59:19,340 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-06 15:59:19,342 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-06 15:59:19,344 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/info 2023-10-06 15:59:19,344 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/info 2023-10-06 15:59:19,345 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-06 15:59:19,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:19,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-06 15:59:19,347 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/rep_barrier 2023-10-06 15:59:19,347 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/rep_barrier 2023-10-06 15:59:19,348 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-06 15:59:19,349 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:19,349 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-06 15:59:19,350 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/table 2023-10-06 15:59:19,351 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/table 2023-10-06 15:59:19,351 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-06 15:59:19,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:19,353 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740 2023-10-06 15:59:19,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740 2023-10-06 15:59:19,359 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-06 15:59:19,361 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-06 15:59:19,362 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73106090, jitterRate=0.0893656313419342}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-06 15:59:19,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-06 15:59:19,377 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696607959255 2023-10-06 15:59:19,396 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-06 15:59:19,397 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-06 15:59:19,397 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41607,1696607957421, state=OPEN 2023-10-06 15:59:19,406 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-06 15:59:19,406 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-06 15:59:19,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-06 15:59:19,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41607,1696607957421 in 356 msec 2023-10-06 15:59:19,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-06 15:59:19,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 565 msec 2023-10-06 15:59:19,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 820 msec 2023-10-06 15:59:19,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696607959423, completionTime=-1 2023-10-06 15:59:19,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-06 15:59:19,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-06 15:59:19,495 DEBUG [hconnection-0x616e7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:19,498 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:19,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-06 15:59:19,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696608019518 2023-10-06 15:59:19,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696608079518 2023-10-06 15:59:19,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 94 msec 2023-10-06 15:59:19,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45793,1696607956151-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45793,1696607956151-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45793,1696607956151-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45793, period=300000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-06 15:59:19,560 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-06 15:59:19,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-06 15:59:19,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-06 15:59:19,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-06 15:59:19,593 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 15:59:19,598 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 15:59:19,620 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a 2023-10-06 15:59:19,622 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a empty. 2023-10-06 15:59:19,623 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a 2023-10-06 15:59:19,623 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-06 15:59:19,660 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-06 15:59:19,663 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2f860cffc116916f00598211b87aaf8a, NAME => 'hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 15:59:19,685 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:19,686 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 2f860cffc116916f00598211b87aaf8a, disabling compactions & flushes 2023-10-06 15:59:19,686 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 15:59:19,686 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 15:59:19,686 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. after waiting 0 ms 2023-10-06 15:59:19,686 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 15:59:19,686 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 15:59:19,686 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 2f860cffc116916f00598211b87aaf8a: 2023-10-06 15:59:19,690 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 15:59:19,705 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696607959693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607959693"}]},"ts":"1696607959693"} 2023-10-06 15:59:19,731 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-06 15:59:19,733 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 15:59:19,738 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607959734"}]},"ts":"1696607959734"} 2023-10-06 15:59:19,742 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-06 15:59:19,747 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 15:59:19,749 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 15:59:19,749 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 15:59:19,749 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 15:59:19,749 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 15:59:19,751 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2f860cffc116916f00598211b87aaf8a, ASSIGN}] 2023-10-06 15:59:19,754 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2f860cffc116916f00598211b87aaf8a, ASSIGN 2023-10-06 15:59:19,756 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2f860cffc116916f00598211b87aaf8a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41607,1696607957421; forceNewPlan=false, retain=false 2023-10-06 15:59:19,908 INFO [jenkins-hbase4:45793] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-06 15:59:19,909 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2f860cffc116916f00598211b87aaf8a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:19,909 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696607959909"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607959909"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607959909"}]},"ts":"1696607959909"} 2023-10-06 15:59:19,913 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2f860cffc116916f00598211b87aaf8a, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 15:59:20,077 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 15:59:20,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f860cffc116916f00598211b87aaf8a, NAME => 'hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a.', STARTKEY => '', ENDKEY => ''} 2023-10-06 15:59:20,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. service=AccessControlService 2023-10-06 15:59:20,079 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:20,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2f860cffc116916f00598211b87aaf8a 2023-10-06 15:59:20,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:20,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2f860cffc116916f00598211b87aaf8a 2023-10-06 15:59:20,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2f860cffc116916f00598211b87aaf8a 2023-10-06 15:59:20,082 INFO [StoreOpener-2f860cffc116916f00598211b87aaf8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2f860cffc116916f00598211b87aaf8a 2023-10-06 15:59:20,085 DEBUG [StoreOpener-2f860cffc116916f00598211b87aaf8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a/info 2023-10-06 15:59:20,085 DEBUG [StoreOpener-2f860cffc116916f00598211b87aaf8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a/info 2023-10-06 15:59:20,085 INFO [StoreOpener-2f860cffc116916f00598211b87aaf8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f860cffc116916f00598211b87aaf8a columnFamilyName info 2023-10-06 15:59:20,086 INFO [StoreOpener-2f860cffc116916f00598211b87aaf8a-1] regionserver.HStore(310): Store=2f860cffc116916f00598211b87aaf8a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:20,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a 2023-10-06 15:59:20,089 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a 2023-10-06 15:59:20,093 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2f860cffc116916f00598211b87aaf8a 2023-10-06 15:59:20,096 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 15:59:20,097 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2f860cffc116916f00598211b87aaf8a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64849171, jitterRate=-0.03367204964160919}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 15:59:20,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2f860cffc116916f00598211b87aaf8a: 2023-10-06 15:59:20,099 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a., pid=6, masterSystemTime=1696607960067 2023-10-06 15:59:20,103 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 15:59:20,103 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 15:59:20,104 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2f860cffc116916f00598211b87aaf8a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:20,105 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696607960104"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696607960104"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696607960104"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696607960104"}]},"ts":"1696607960104"} 2023-10-06 15:59:20,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-06 15:59:20,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2f860cffc116916f00598211b87aaf8a, server=jenkins-hbase4.apache.org,41607,1696607957421 in 196 msec 2023-10-06 15:59:20,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-06 15:59:20,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2f860cffc116916f00598211b87aaf8a, ASSIGN in 361 msec 2023-10-06 15:59:20,117 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 15:59:20,118 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607960118"}]},"ts":"1696607960118"} 2023-10-06 15:59:20,120 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-06 15:59:20,123 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 15:59:20,126 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 544 msec 2023-10-06 15:59:20,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-06 15:59:20,195 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-06 15:59:20,195 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 15:59:20,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-06 15:59:20,244 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-06 15:59:20,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-10-06 15:59:20,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-06 15:59:20,272 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-06 15:59:20,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-10-06 15:59:20,288 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-06 15:59:20,290 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-06 15:59:20,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.715sec 2023-10-06 15:59:20,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-06 15:59:20,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-06 15:59:20,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-06 15:59:20,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45793,1696607956151-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-06 15:59:20,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45793,1696607956151-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-06 15:59:20,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-06 15:59:20,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-06 15:59:20,322 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 15:59:20,324 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 15:59:20,326 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/hbase/acl/286f21d97265c26f36f00f289a586742 2023-10-06 15:59:20,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-06 15:59:20,327 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/hbase/acl/286f21d97265c26f36f00f289a586742 empty. 2023-10-06 15:59:20,330 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/hbase/acl/286f21d97265c26f36f00f289a586742 2023-10-06 15:59:20,330 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-06 15:59:20,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 15:59:20,341 DEBUG [Listener at localhost/36163] zookeeper.ReadOnlyZKClient(139): Connect 0x292a7714 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:20,352 DEBUG [Listener at localhost/36163] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10727052, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:20,357 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-06 15:59:20,360 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 286f21d97265c26f36f00f289a586742, NAME => 'hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 15:59:20,377 DEBUG [hconnection-0x732bbf84-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:20,388 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:20,389 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 286f21d97265c26f36f00f289a586742, disabling compactions & flushes 2023-10-06 15:59:20,389 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 15:59:20,389 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 15:59:20,389 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. after waiting 0 ms 2023-10-06 15:59:20,389 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 15:59:20,389 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 15:59:20,389 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 286f21d97265c26f36f00f289a586742: 2023-10-06 15:59:20,395 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 15:59:20,395 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:20,396 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696607960396"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607960396"}]},"ts":"1696607960396"} 2023-10-06 15:59:20,398 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45793,1696607956151 2023-10-06 15:59:20,398 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-06 15:59:20,398 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/test.cache.data in system properties and HBase conf 2023-10-06 15:59:20,398 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/hadoop.tmp.dir in system properties and HBase conf 2023-10-06 15:59:20,398 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/hadoop.log.dir in system properties and HBase conf 2023-10-06 15:59:20,398 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-06 15:59:20,399 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-06 15:59:20,399 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-06 15:59:20,399 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-06 15:59:20,399 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-06 15:59:20,399 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-06 15:59:20,399 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-06 15:59:20,399 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 15:59:20,399 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-06 15:59:20,400 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-06 15:59:20,400 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-06 15:59:20,400 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 15:59:20,400 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-06 15:59:20,400 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/nfs.dump.dir in system properties and HBase conf 2023-10-06 15:59:20,400 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/java.io.tmpdir in system properties and HBase conf 2023-10-06 15:59:20,400 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-06 15:59:20,400 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-06 15:59:20,400 INFO [Listener at localhost/36163] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-06 15:59:20,401 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 15:59:20,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607960401"}]},"ts":"1696607960401"} 2023-10-06 15:59:20,403 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-06 15:59:20,411 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 15:59:20,413 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 15:59:20,413 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 15:59:20,413 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 15:59:20,413 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 15:59:20,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=286f21d97265c26f36f00f289a586742, ASSIGN}] 2023-10-06 15:59:20,416 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=286f21d97265c26f36f00f289a586742, ASSIGN 2023-10-06 15:59:20,417 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=286f21d97265c26f36f00f289a586742, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41607,1696607957421; forceNewPlan=false, retain=false 2023-10-06 15:59:20,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 15:59:20,567 INFO [jenkins-hbase4:45793] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-06 15:59:20,568 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=286f21d97265c26f36f00f289a586742, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:20,569 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696607960568"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607960568"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607960568"}]},"ts":"1696607960568"} 2023-10-06 15:59:20,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 286f21d97265c26f36f00f289a586742, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 15:59:20,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 15:59:20,732 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 15:59:20,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 286f21d97265c26f36f00f289a586742, NAME => 'hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742.', STARTKEY => '', ENDKEY => ''} 2023-10-06 15:59:20,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. service=AccessControlService 2023-10-06 15:59:20,734 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:20,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 286f21d97265c26f36f00f289a586742 2023-10-06 15:59:20,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:20,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 286f21d97265c26f36f00f289a586742 2023-10-06 15:59:20,734 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 286f21d97265c26f36f00f289a586742 2023-10-06 15:59:20,736 INFO [StoreOpener-286f21d97265c26f36f00f289a586742-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 286f21d97265c26f36f00f289a586742 2023-10-06 15:59:20,739 DEBUG [StoreOpener-286f21d97265c26f36f00f289a586742-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/acl/286f21d97265c26f36f00f289a586742/l 2023-10-06 15:59:20,739 DEBUG [StoreOpener-286f21d97265c26f36f00f289a586742-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/acl/286f21d97265c26f36f00f289a586742/l 2023-10-06 15:59:20,739 INFO [StoreOpener-286f21d97265c26f36f00f289a586742-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 286f21d97265c26f36f00f289a586742 columnFamilyName l 2023-10-06 15:59:20,740 INFO [StoreOpener-286f21d97265c26f36f00f289a586742-1] regionserver.HStore(310): Store=286f21d97265c26f36f00f289a586742/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:20,742 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/acl/286f21d97265c26f36f00f289a586742 2023-10-06 15:59:20,743 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/acl/286f21d97265c26f36f00f289a586742 2023-10-06 15:59:20,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 286f21d97265c26f36f00f289a586742 2023-10-06 15:59:20,751 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/acl/286f21d97265c26f36f00f289a586742/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 15:59:20,751 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 286f21d97265c26f36f00f289a586742; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69189258, jitterRate=0.0310002863407135}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 15:59:20,752 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 286f21d97265c26f36f00f289a586742: 2023-10-06 15:59:20,753 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742., pid=11, masterSystemTime=1696607960727 2023-10-06 15:59:20,756 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 15:59:20,756 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 15:59:20,757 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=286f21d97265c26f36f00f289a586742, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:20,758 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696607960757"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696607960757"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696607960757"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696607960757"}]},"ts":"1696607960757"} 2023-10-06 15:59:20,764 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-06 15:59:20,764 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 286f21d97265c26f36f00f289a586742, server=jenkins-hbase4.apache.org,41607,1696607957421 in 188 msec 2023-10-06 15:59:20,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-06 15:59:20,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=286f21d97265c26f36f00f289a586742, ASSIGN in 351 msec 2023-10-06 15:59:20,769 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 15:59:20,769 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607960769"}]},"ts":"1696607960769"} 2023-10-06 15:59:20,772 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-06 15:59:20,776 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 15:59:20,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 457 msec 2023-10-06 15:59:20,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-06 15:59:20,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-06 15:59:20,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-06 15:59:21,528 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 15:59:21,802 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 15:59:21,807 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45469_jobhistory____l4f727/webapp 2023-10-06 15:59:21,945 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-06 15:59:21,945 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-06 15:59:21,945 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 15:59:21,948 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 15:59:22,016 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 15:59:22,306 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 15:59:22,560 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-06 15:59:22,592 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45469 2023-10-06 15:59:23,020 WARN [Listener at jenkins-hbase4.apache.org/45451] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 15:59:23,266 WARN [Listener at jenkins-hbase4.apache.org/45451] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-06 15:59:23,267 INFO [Listener at jenkins-hbase4.apache.org/45451] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 15:59:23,273 INFO [Listener at jenkins-hbase4.apache.org/45451] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41177_cluster____zf7pbk/webapp 2023-10-06 15:59:23,338 INFO [Listener at jenkins-hbase4.apache.org/45451] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-06 15:59:23,338 INFO [Listener at jenkins-hbase4.apache.org/45451] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-06 15:59:23,338 INFO [Listener at jenkins-hbase4.apache.org/45451] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 15:59:23,339 INFO [Listener at jenkins-hbase4.apache.org/45451] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 15:59:23,346 INFO [Listener at jenkins-hbase4.apache.org/45451] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 15:59:23,517 INFO [Listener at jenkins-hbase4.apache.org/45451] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 15:59:23,592 INFO [Listener at jenkins-hbase4.apache.org/45451] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 15:59:23,598 INFO [Listener at jenkins-hbase4.apache.org/45451] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41177 2023-10-06 15:59:24,012 WARN [Listener at jenkins-hbase4.apache.org/36879] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 15:59:24,041 WARN [Listener at jenkins-hbase4.apache.org/36879] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-06 15:59:24,042 INFO [Listener at jenkins-hbase4.apache.org/36879] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 15:59:24,049 INFO [Listener at jenkins-hbase4.apache.org/36879] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39965_node____.acvvao/webapp 2023-10-06 15:59:24,104 INFO [Listener at jenkins-hbase4.apache.org/36879] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-06 15:59:24,104 INFO [Listener at jenkins-hbase4.apache.org/36879] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 15:59:24,104 INFO [Listener at jenkins-hbase4.apache.org/36879] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-06 15:59:24,105 INFO [Listener at jenkins-hbase4.apache.org/36879] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 15:59:24,113 INFO [Listener at jenkins-hbase4.apache.org/36879] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 15:59:24,131 INFO [Listener at jenkins-hbase4.apache.org/36879] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 15:59:24,189 INFO [Listener at jenkins-hbase4.apache.org/36879] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 15:59:24,198 INFO [Listener at jenkins-hbase4.apache.org/36879] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39965 2023-10-06 15:59:24,396 WARN [Listener at jenkins-hbase4.apache.org/39073] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-06 15:59:24,406 WARN [Listener at jenkins-hbase4.apache.org/39073] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-06 15:59:24,406 INFO [Listener at jenkins-hbase4.apache.org/39073] log.Slf4jLog(67): jetty-6.1.26 2023-10-06 15:59:24,411 INFO [Listener at jenkins-hbase4.apache.org/39073] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39099_node____.e9ttw8/webapp 2023-10-06 15:59:24,460 INFO [Listener at jenkins-hbase4.apache.org/39073] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-06 15:59:24,461 INFO [Listener at jenkins-hbase4.apache.org/39073] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-06 15:59:24,461 INFO [Listener at jenkins-hbase4.apache.org/39073] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-06 15:59:24,461 INFO [Listener at jenkins-hbase4.apache.org/39073] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-06 15:59:24,468 INFO [Listener at jenkins-hbase4.apache.org/39073] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 15:59:24,479 INFO [Listener at jenkins-hbase4.apache.org/39073] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 15:59:24,533 INFO [Listener at jenkins-hbase4.apache.org/39073] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-06 15:59:24,538 INFO [Listener at jenkins-hbase4.apache.org/39073] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39099 2023-10-06 15:59:24,559 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-06 15:59:24,561 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 15:59:24,618 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=703, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=164, AvailableMemoryMB=3382 2023-10-06 15:59:24,618 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=703 is superior to 500 2023-10-06 15:59:24,631 DEBUG [Listener at jenkins-hbase4.apache.org/39073] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-06 15:59:24,636 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-06 15:59:24,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 15:59:24,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-06 15:59:24,648 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 15:59:24,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-06 15:59:24,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 15:59:24,650 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 15:59:24,655 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:24,655 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:24,657 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901 empty. 2023-10-06 15:59:24,657 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8 empty. 2023-10-06 15:59:24,658 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:24,658 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:24,659 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-06 15:59:24,691 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-06 15:59:24,693 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9c660a0b0fd98acb1d7f150e613ee6c8, NAME => 'testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 15:59:24,696 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2cb3cf1917c29233054002d2d95a9901, NAME => 'testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 15:59:24,734 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:24,735 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 9c660a0b0fd98acb1d7f150e613ee6c8, disabling compactions & flushes 2023-10-06 15:59:24,735 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:24,736 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:24,736 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. after waiting 0 ms 2023-10-06 15:59:24,736 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:24,736 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:24,736 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 9c660a0b0fd98acb1d7f150e613ee6c8: 2023-10-06 15:59:24,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:24,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 2cb3cf1917c29233054002d2d95a9901, disabling compactions & flushes 2023-10-06 15:59:24,739 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:24,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:24,739 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. after waiting 0 ms 2023-10-06 15:59:24,740 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:24,740 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:24,740 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 2cb3cf1917c29233054002d2d95a9901: 2023-10-06 15:59:24,744 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 15:59:24,745 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696607964745"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607964745"}]},"ts":"1696607964745"} 2023-10-06 15:59:24,745 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696607964745"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607964745"}]},"ts":"1696607964745"} 2023-10-06 15:59:24,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 15:59:24,792 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 15:59:24,793 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 15:59:24,794 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607964794"}]},"ts":"1696607964794"} 2023-10-06 15:59:24,796 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-06 15:59:24,802 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 15:59:24,807 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 15:59:24,807 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 15:59:24,807 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 15:59:24,807 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 15:59:24,807 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9c660a0b0fd98acb1d7f150e613ee6c8, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2cb3cf1917c29233054002d2d95a9901, ASSIGN}] 2023-10-06 15:59:24,810 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9c660a0b0fd98acb1d7f150e613ee6c8, ASSIGN 2023-10-06 15:59:24,810 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2cb3cf1917c29233054002d2d95a9901, ASSIGN 2023-10-06 15:59:24,811 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2cb3cf1917c29233054002d2d95a9901, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32989,1696607957469; forceNewPlan=false, retain=false 2023-10-06 15:59:24,811 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9c660a0b0fd98acb1d7f150e613ee6c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41607,1696607957421; forceNewPlan=false, retain=false 2023-10-06 15:59:24,903 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 15:59:24,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 15:59:24,961 INFO [jenkins-hbase4:45793] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 15:59:24,963 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2cb3cf1917c29233054002d2d95a9901, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:24,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9c660a0b0fd98acb1d7f150e613ee6c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:24,964 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696607964963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607964963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607964963"}]},"ts":"1696607964963"} 2023-10-06 15:59:24,964 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696607964963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607964963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607964963"}]},"ts":"1696607964963"} 2023-10-06 15:59:24,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 2cb3cf1917c29233054002d2d95a9901, server=jenkins-hbase4.apache.org,32989,1696607957469}] 2023-10-06 15:59:24,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 9c660a0b0fd98acb1d7f150e613ee6c8, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 15:59:25,061 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-06 15:59:25,063 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-06 15:59:25,064 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-06 15:59:25,134 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:25,134 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 15:59:25,139 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 15:59:25,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:25,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c660a0b0fd98acb1d7f150e613ee6c8, NAME => 'testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 15:59:25,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. service=AccessControlService 2023-10-06 15:59:25,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:25,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:25,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:25,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:25,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:25,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:25,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2cb3cf1917c29233054002d2d95a9901, NAME => 'testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 15:59:25,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. service=AccessControlService 2023-10-06 15:59:25,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:25,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:25,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:25,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:25,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:25,148 INFO [StoreOpener-9c660a0b0fd98acb1d7f150e613ee6c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:25,148 INFO [StoreOpener-2cb3cf1917c29233054002d2d95a9901-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:25,150 DEBUG [StoreOpener-2cb3cf1917c29233054002d2d95a9901-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/cf 2023-10-06 15:59:25,151 DEBUG [StoreOpener-2cb3cf1917c29233054002d2d95a9901-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/cf 2023-10-06 15:59:25,151 DEBUG [StoreOpener-9c660a0b0fd98acb1d7f150e613ee6c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/cf 2023-10-06 15:59:25,151 DEBUG [StoreOpener-9c660a0b0fd98acb1d7f150e613ee6c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/cf 2023-10-06 15:59:25,154 INFO [StoreOpener-2cb3cf1917c29233054002d2d95a9901-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2cb3cf1917c29233054002d2d95a9901 columnFamilyName cf 2023-10-06 15:59:25,154 INFO [StoreOpener-9c660a0b0fd98acb1d7f150e613ee6c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c660a0b0fd98acb1d7f150e613ee6c8 columnFamilyName cf 2023-10-06 15:59:25,157 INFO [StoreOpener-9c660a0b0fd98acb1d7f150e613ee6c8-1] regionserver.HStore(310): Store=9c660a0b0fd98acb1d7f150e613ee6c8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:25,157 INFO [StoreOpener-2cb3cf1917c29233054002d2d95a9901-1] regionserver.HStore(310): Store=2cb3cf1917c29233054002d2d95a9901/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:25,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:25,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:25,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:25,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:25,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:25,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:25,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 15:59:25,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 15:59:25,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9c660a0b0fd98acb1d7f150e613ee6c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64623825, jitterRate=-0.037029966711997986}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 15:59:25,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9c660a0b0fd98acb1d7f150e613ee6c8: 2023-10-06 15:59:25,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2cb3cf1917c29233054002d2d95a9901; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59540809, jitterRate=-0.11277280747890472}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 15:59:25,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2cb3cf1917c29233054002d2d95a9901: 2023-10-06 15:59:25,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8., pid=16, masterSystemTime=1696607965135 2023-10-06 15:59:25,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901., pid=15, masterSystemTime=1696607965134 2023-10-06 15:59:25,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:25,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:25,186 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9c660a0b0fd98acb1d7f150e613ee6c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:25,187 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696607965186"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696607965186"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696607965186"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696607965186"}]},"ts":"1696607965186"} 2023-10-06 15:59:25,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:25,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:25,189 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2cb3cf1917c29233054002d2d95a9901, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:25,190 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696607965189"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696607965189"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696607965189"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696607965189"}]},"ts":"1696607965189"} 2023-10-06 15:59:25,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-10-06 15:59:25,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 9c660a0b0fd98acb1d7f150e613ee6c8, server=jenkins-hbase4.apache.org,41607,1696607957421 in 211 msec 2023-10-06 15:59:25,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-06 15:59:25,199 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 2cb3cf1917c29233054002d2d95a9901, server=jenkins-hbase4.apache.org,32989,1696607957469 in 221 msec 2023-10-06 15:59:25,201 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9c660a0b0fd98acb1d7f150e613ee6c8, ASSIGN in 389 msec 2023-10-06 15:59:25,202 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-10-06 15:59:25,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2cb3cf1917c29233054002d2d95a9901, ASSIGN in 392 msec 2023-10-06 15:59:25,204 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 15:59:25,204 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607965204"}]},"ts":"1696607965204"} 2023-10-06 15:59:25,206 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-06 15:59:25,209 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 15:59:25,213 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-06 15:59:25,231 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-06 15:59:25,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 15:59:25,261 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:25,261 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:25,261 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 15:59:25,261 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:25,261 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:25,271 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 15:59:25,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:25,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:25,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:25,273 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:25,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 629 msec 2023-10-06 15:59:25,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-06 15:59:25,758 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-06 15:59:25,762 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-06 15:59:25,763 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:25,766 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 15:59:25,792 DEBUG [hconnection-0x732bbf84-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:25,797 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:25,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 15:59:25,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696607965811 (current time:1696607965811). 2023-10-06 15:59:25,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 15:59:25,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x48b7fe56 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:25,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@326ecdc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:25,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:25,823 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:25,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48b7fe56 to 127.0.0.1:55741 2023-10-06 15:59:25,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:25,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x15d560d1 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:25,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46b2142c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:25,836 DEBUG [hconnection-0x325aed3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:25,839 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:25,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15d560d1 to 127.0.0.1:55741 2023-10-06 15:59:25,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:25,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-06 15:59:25,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 15:59:25,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 15:59:25,885 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 15:59:25,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 15:59:25,907 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 15:59:25,908 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696608565908 2023-10-06 15:59:25,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 15:59:25,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-06 15:59:25,911 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 15:59:25,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 15:59:25,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-10-06 15:59:25,915 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 15:59:25,916 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696608565916 2023-10-06 15:59:25,916 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 15:59:25,916 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 15:59:25,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,938 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-06 15:59:25,939 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:25,939 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-06 15:59:25,939 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-06 15:59:25,940 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,940 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,950 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:25,950 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:25,950 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:25,950 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:25,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:25,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:25,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:25,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:25,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:25,950 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:25,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:25,951 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,951 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:25,951 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 15:59:25,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-06 15:59:25,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-06 15:59:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-06 15:59:25,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,954 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 15:59:25,954 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 15:59:25,954 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 15:59:25,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,957 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 15:59:25,957 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 15:59:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 15:59:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:25,958 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:25,959 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 15:59:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 15:59:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-06 15:59:25,959 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 15:59:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-06 15:59:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-06 15:59:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-06 15:59:25,961 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-06 15:59:25,961 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-06 15:59:25,963 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,964 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,964 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:25,964 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,964 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:25,964 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:25,964 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:25,965 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,965 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:25,965 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:25,965 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:25,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-06 15:59:25,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23975d91[Count = 1] remaining members to acquire global barrier 2023-10-06 15:59:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:25,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:25,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:25,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:25,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-06 15:59:25,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23975d91[Count = 0] remaining members to acquire global barrier 2023-10-06 15:59:25,971 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-06 15:59:25,971 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,973 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,973 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,973 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,974 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:25,974 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 15:59:25,974 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 15:59:25,974 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-06 15:59:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,974 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 15:59:25,974 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:25,974 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 15:59:25,974 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 15:59:25,975 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:25,975 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:25,975 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:25,975 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:25,976 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:25,975 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:25,976 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. started... 2023-10-06 15:59:25,976 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. started... 2023-10-06 15:59:25,979 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2cb3cf1917c29233054002d2d95a9901: 2023-10-06 15:59:25,979 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c660a0b0fd98acb1d7f150e613ee6c8: 2023-10-06 15:59:25,980 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,980 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:25,983 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 15:59:25,983 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:25,983 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-06 15:59:25,987 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:25,987 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:25,991 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 15:59:25,991 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 15:59:26,015 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. completed. 2023-10-06 15:59:26,015 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:26,016 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:26,022 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:26,024 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:26,025 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,025 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-06 15:59:26,025 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 15:59:26,030 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:26,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:26,031 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 15:59:26,031 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:26,031 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-06 15:59:26,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 15:59:26,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:26,033 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. completed. 2023-10-06 15:59:26,034 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:26,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:26,034 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:26,034 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:26,034 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,034 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-06 15:59:26,034 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 15:59:26,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 15:59:26,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,035 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 15:59:26,036 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 15:59:26,036 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,036 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,036 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-06 15:59:26,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:26,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,32989,1696607957469': 2023-10-06 15:59:26,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-06 15:59:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:26,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:26,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41607,1696607957421': 2023-10-06 15:59:26,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-06 15:59:26,046 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-06 15:59:26,046 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 15:59:26,046 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 15:59:26,046 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,046 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 15:59:26,048 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,048 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,049 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,049 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,049 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,048 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,049 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:26,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:26,050 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:26,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,050 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,051 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:26,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,054 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:26,054 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,055 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,068 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,068 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:26,068 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:26,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:26,068 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,068 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:26,069 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:26,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:26,069 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:26,069 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,069 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-06 15:59:26,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:26,069 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,069 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:26,069 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:26,070 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,070 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 15:59:26,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,071 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,071 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,071 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,072 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,072 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 15:59:26,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,145 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-06 15:59:26,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,146 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:26,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696607965909Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696607966092 (+183 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696607966092Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696607966092Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696607966107 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696607966133 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696607966145 (+12 ms) 2023-10-06 15:59:26,147 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 15:59:26,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 237 msec 2023-10-06 15:59:26,236 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:26,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 15:59:26,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 15:59:26,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41607] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 15:59:26,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32989] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 15:59:26,268 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-06 15:59:26,268 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:26,268 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 15:59:26,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 15:59:26,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696607966283 (current time:1696607966283). 2023-10-06 15:59:26,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 15:59:26,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x47023b34 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:26,313 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 15:59:26,314 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-06 15:59:26,314 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 15:59:26,314 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-06 15:59:26,315 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-06 15:59:26,315 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-06 15:59:26,315 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 15:59:26,315 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-06 15:59:26,315 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-06 15:59:26,315 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-06 15:59:26,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@436983d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:26,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:26,341 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:26,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47023b34 to 127.0.0.1:55741 2023-10-06 15:59:26,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:26,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x5858ec0e to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:26,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e55a7aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:26,425 DEBUG [hconnection-0x1ad82fb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:26,428 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:26,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5858ec0e to 127.0.0.1:55741 2023-10-06 15:59:26,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:26,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-06 15:59:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 15:59:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 15:59:26,438 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 15:59:26,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 15:59:26,441 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 15:59:26,442 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696608566442 2023-10-06 15:59:26,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-06 15:59:26,442 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-06 15:59:26,443 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 15:59:26,444 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 15:59:26,445 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-06 15:59:26,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 15:59:26,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-10-06 15:59:26,448 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 15:59:26,449 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696608566449 2023-10-06 15:59:26,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-06 15:59:26,465 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-06 15:59:26,465 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:26,466 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-06 15:59:26,466 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-06 15:59:26,466 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,466 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,467 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:26,467 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:26,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:26,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:26,468 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,467 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:26,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:26,468 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,468 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,469 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,469 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 15:59:26,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-06 15:59:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-06 15:59:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-06 15:59:26,470 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 15:59:26,470 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 15:59:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,470 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-06 15:59:26,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-06 15:59:26,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-06 15:59:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 15:59:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 15:59:26,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-06 15:59:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:26,473 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-06 15:59:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 15:59:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-06 15:59:26,473 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-06 15:59:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 15:59:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-06 15:59:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-06 15:59:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-06 15:59:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-06 15:59:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-06 15:59:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,478 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,478 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 15:59:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:26,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-06 15:59:26,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79a5b250[Count = 1] remaining members to acquire global barrier 2023-10-06 15:59:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:26,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:26,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:26,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 15:59:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:26,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-06 15:59:26,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79a5b250[Count = 0] remaining members to acquire global barrier 2023-10-06 15:59:26,486 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-06 15:59:26,486 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,492 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,492 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,492 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,493 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,493 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 15:59:26,493 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 15:59:26,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,493 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:26,493 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:26,493 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-06 15:59:26,493 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,493 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 15:59:26,493 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:26,493 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-06 15:59:26,493 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:26,493 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. started... 2023-10-06 15:59:26,494 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. started... 2023-10-06 15:59:26,493 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:26,493 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 15:59:26,494 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9c660a0b0fd98acb1d7f150e613ee6c8 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-06 15:59:26,494 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2cb3cf1917c29233054002d2d95a9901 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-06 15:59:26,494 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:26,496 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 15:59:26,496 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:26,496 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-06 15:59:26,544 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:26,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 15:59:26,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 15:59:26,546 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 15:59:26,642 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006ec1630f73716451e92d315e63378a43d to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006ec1630f73716451e92d315e63378a43d 2023-10-06 15:59:26,642 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231006b6ede254749a4d53b0d52088a4ba7f26 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231006b6ede254749a4d53b0d52088a4ba7f26 2023-10-06 15:59:26,672 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/.tmp/cf/7dc72dc63311406e8b83de13de80ce00 2023-10-06 15:59:26,673 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/.tmp/cf/062e67cd0e3e43b7a4adf53bec295ef2 2023-10-06 15:59:26,684 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/.tmp/cf/7dc72dc63311406e8b83de13de80ce00 as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/cf/7dc72dc63311406e8b83de13de80ce00 2023-10-06 15:59:26,684 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/.tmp/cf/062e67cd0e3e43b7a4adf53bec295ef2 as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/cf/062e67cd0e3e43b7a4adf53bec295ef2 2023-10-06 15:59:26,692 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/cf/7dc72dc63311406e8b83de13de80ce00, entries=45, sequenceid=6, filesize=12.5 K 2023-10-06 15:59:26,694 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/cf/062e67cd0e3e43b7a4adf53bec295ef2, entries=5, sequenceid=6, filesize=5.7 K 2023-10-06 15:59:26,698 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 2cb3cf1917c29233054002d2d95a9901 in 204ms, sequenceid=6, compaction requested=false 2023-10-06 15:59:26,698 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 9c660a0b0fd98acb1d7f150e613ee6c8 in 204ms, sequenceid=6, compaction requested=false 2023-10-06 15:59:26,698 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-06 15:59:26,698 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-06 15:59:26,701 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2cb3cf1917c29233054002d2d95a9901: 2023-10-06 15:59:26,701 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c660a0b0fd98acb1d7f150e613ee6c8: 2023-10-06 15:59:26,701 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-06 15:59:26,701 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:26,701 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/cf/7dc72dc63311406e8b83de13de80ce00] hfiles 2023-10-06 15:59:26,701 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-06 15:59:26,701 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/cf/7dc72dc63311406e8b83de13de80ce00 for snapshot=snaptb0-testExportWithTargetName 2023-10-06 15:59:26,701 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:26,701 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/cf/062e67cd0e3e43b7a4adf53bec295ef2] hfiles 2023-10-06 15:59:26,701 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/cf/062e67cd0e3e43b7a4adf53bec295ef2 for snapshot=snaptb0-testExportWithTargetName 2023-10-06 15:59:26,721 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. completed. 2023-10-06 15:59:26,721 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:26,722 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:26,722 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:26,722 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,722 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-06 15:59:26,722 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 15:59:26,726 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 15:59:26,726 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:26,726 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-06 15:59:26,727 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. completed. 2023-10-06 15:59:26,727 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:26,727 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:26,727 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:26,727 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,727 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-06 15:59:26,727 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 15:59:26,729 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-06 15:59:26,729 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:26,729 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-06 15:59:26,732 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,733 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:26,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:26,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:26,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:26,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 15:59:26,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 15:59:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,32989,1696607957469': 2023-10-06 15:59:26,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-06 15:59:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:26,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 15:59:26,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:26,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 15:59:26,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,41607,1696607957421': 2023-10-06 15:59:26,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-06 15:59:26,742 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-06 15:59:26,742 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 15:59:26,742 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 15:59:26,742 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-06 15:59:26,742 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 15:59:26,746 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:26,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 15:59:26,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-06 15:59:26,748 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-06 15:59:26,748 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,748 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,748 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,748 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,748 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,749 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,749 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:26,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,749 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:26,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,750 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 15:59:26,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,751 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:26,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-06 15:59:26,753 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,753 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,754 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,771 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:26,771 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:26,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:26,772 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:26,772 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:26,772 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-06 15:59:26,772 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:26,772 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,772 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,772 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-06 15:59:26,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,772 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:26,772 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:26,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:26,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-06 15:59:26,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 15:59:26,772 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:26,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:26,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:26,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:26,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:26,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:26,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:26,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231006b6ede254749a4d53b0d52088a4ba7f26, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006ec1630f73716451e92d315e63378a43d] mob files 2023-10-06 15:59:26,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231006b6ede254749a4d53b0d52088a4ba7f26 2023-10-06 15:59:26,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006ec1630f73716451e92d315e63378a43d 2023-10-06 15:59:26,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-10-06 15:59:26,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-06 15:59:26,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-06 15:59:26,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,830 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-06 15:59:26,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696607966442Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696607966792 (+350 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696607966792Loading Region manifests for snaptb0-testExportWithTargetName at 1696607966793 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1696607966798 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696607966818 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696607966830 (+12 ms) 2023-10-06 15:59:26,832 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-06 15:59:26,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 389 msec 2023-10-06 15:59:27,048 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:27,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-06 15:59:27,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 15:59:27,052 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607967052 2023-10-06 15:59:27,052 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34141, tgtDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607967052, rawTgtDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607967052, srcFsUri=hdfs://localhost:34141, srcDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 15:59:27,094 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 15:59:27,095 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1855085085_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607967052, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607967052/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-06 15:59:27,095 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca, snapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-06 15:59:27,114 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607967052/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-06 15:59:27,177 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,178 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,179 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,179 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,180 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,180 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,181 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,267 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/hadoop-6493955540952607559.jar 2023-10-06 15:59:27,268 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,268 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,269 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,269 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,270 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,270 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:27,271 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.5/hbase-shaded-miscellaneous-4.1.5.jar 2023-10-06 15:59:27,272 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.5/hbase-shaded-gson-4.1.5.jar 2023-10-06 15:59:27,273 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.5/hbase-shaded-protobuf-4.1.5.jar 2023-10-06 15:59:27,274 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.5/hbase-shaded-netty-4.1.5.jar 2023-10-06 15:59:27,274 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.5/hbase-unsafe-4.1.5.jar 2023-10-06 15:59:27,275 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 15:59:27,276 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 15:59:27,276 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 15:59:27,277 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 15:59:27,278 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 15:59:27,282 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:27,282 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:27,283 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 15:59:27,283 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:27,284 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:27,284 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 15:59:27,285 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 15:59:28,065 WARN [Listener at jenkins-hbase4.apache.org/39073] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 15:59:28,071 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-06 15:59:28,080 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-06 15:59:28,485 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 15:59:28,486 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 15:59:28,700 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0001_000001 (auth:SIMPLE) 2023-10-06 15:59:30,651 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 15:59:32,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0001_000001 (auth:SIMPLE) 2023-10-06 15:59:35,143 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0001_000001 (auth:SIMPLE) 2023-10-06 15:59:38,342 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0001_000001 (auth:SIMPLE) 2023-10-06 15:59:39,878 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 15:59:39,881 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 15:59:39,891 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-06 15:59:39,892 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 15:59:39,892 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 15:59:39,893 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-06 15:59:39,893 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-06 15:59:39,893 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-06 15:59:39,893 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607967052/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607967052/.hbase-snapshot/testExportWithTargetName 2023-10-06 15:59:39,894 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607967052/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-06 15:59:39,894 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607967052/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-06 15:59:39,905 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-06 15:59:39,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-06 15:59:39,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-06 15:59:39,926 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607979925"}]},"ts":"1696607979925"} 2023-10-06 15:59:39,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-06 15:59:39,928 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-06 15:59:39,930 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-06 15:59:39,932 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9c660a0b0fd98acb1d7f150e613ee6c8, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2cb3cf1917c29233054002d2d95a9901, UNASSIGN}] 2023-10-06 15:59:39,934 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9c660a0b0fd98acb1d7f150e613ee6c8, UNASSIGN 2023-10-06 15:59:39,934 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2cb3cf1917c29233054002d2d95a9901, UNASSIGN 2023-10-06 15:59:39,935 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9c660a0b0fd98acb1d7f150e613ee6c8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:39,935 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2cb3cf1917c29233054002d2d95a9901, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:39,935 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696607979935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607979935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607979935"}]},"ts":"1696607979935"} 2023-10-06 15:59:39,935 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696607979935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607979935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607979935"}]},"ts":"1696607979935"} 2023-10-06 15:59:39,937 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 9c660a0b0fd98acb1d7f150e613ee6c8, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 15:59:39,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 2cb3cf1917c29233054002d2d95a9901, server=jenkins-hbase4.apache.org,32989,1696607957469}] 2023-10-06 15:59:40,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-06 15:59:40,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:40,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:40,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9c660a0b0fd98acb1d7f150e613ee6c8, disabling compactions & flushes 2023-10-06 15:59:40,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2cb3cf1917c29233054002d2d95a9901, disabling compactions & flushes 2023-10-06 15:59:40,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:40,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:40,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:40,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:40,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. after waiting 0 ms 2023-10-06 15:59:40,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:40,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. after waiting 0 ms 2023-10-06 15:59:40,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:40,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 15:59:40,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 15:59:40,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 15:59:40,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 15:59:40,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8. 2023-10-06 15:59:40,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901. 2023-10-06 15:59:40,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9c660a0b0fd98acb1d7f150e613ee6c8: 2023-10-06 15:59:40,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2cb3cf1917c29233054002d2d95a9901: 2023-10-06 15:59:40,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:40,119 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2cb3cf1917c29233054002d2d95a9901, regionState=CLOSED 2023-10-06 15:59:40,119 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696607980119"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607980119"}]},"ts":"1696607980119"} 2023-10-06 15:59:40,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:40,120 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=9c660a0b0fd98acb1d7f150e613ee6c8, regionState=CLOSED 2023-10-06 15:59:40,120 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696607980120"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607980120"}]},"ts":"1696607980120"} 2023-10-06 15:59:40,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-06 15:59:40,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 2cb3cf1917c29233054002d2d95a9901, server=jenkins-hbase4.apache.org,32989,1696607957469 in 184 msec 2023-10-06 15:59:40,126 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-06 15:59:40,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2cb3cf1917c29233054002d2d95a9901, UNASSIGN in 192 msec 2023-10-06 15:59:40,126 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 9c660a0b0fd98acb1d7f150e613ee6c8, server=jenkins-hbase4.apache.org,41607,1696607957421 in 185 msec 2023-10-06 15:59:40,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-10-06 15:59:40,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9c660a0b0fd98acb1d7f150e613ee6c8, UNASSIGN in 195 msec 2023-10-06 15:59:40,131 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607980131"}]},"ts":"1696607980131"} 2023-10-06 15:59:40,133 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-06 15:59:40,135 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-06 15:59:40,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 222 msec 2023-10-06 15:59:40,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-06 15:59:40,230 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-06 15:59:40,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-06 15:59:40,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 15:59:40,244 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 15:59:40,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-06 15:59:40,246 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 15:59:40,249 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-06 15:59:40,252 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:40,252 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:40,253 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 15:59:40,253 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 15:59:40,253 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 15:59:40,253 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 15:59:40,254 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-06 15:59:40,254 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-06 15:59:40,254 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-06 15:59:40,254 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-10-06 15:59:40,255 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 15:59:40,255 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:40,255 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 15:59:40,255 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:40,255 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 15:59:40,256 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:40,255 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-06 15:59:40,256 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:40,256 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/recovered.edits] 2023-10-06 15:59:40,256 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/recovered.edits] 2023-10-06 15:59:40,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-06 15:59:40,264 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/cf/062e67cd0e3e43b7a4adf53bec295ef2 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/cf/062e67cd0e3e43b7a4adf53bec295ef2 2023-10-06 15:59:40,265 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/cf/7dc72dc63311406e8b83de13de80ce00 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/cf/7dc72dc63311406e8b83de13de80ce00 2023-10-06 15:59:40,268 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8/recovered.edits/9.seqid 2023-10-06 15:59:40,269 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901/recovered.edits/9.seqid 2023-10-06 15:59:40,269 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/9c660a0b0fd98acb1d7f150e613ee6c8 2023-10-06 15:59:40,270 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportWithTargetName/2cb3cf1917c29233054002d2d95a9901 2023-10-06 15:59:40,270 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-06 15:59:40,270 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-06 15:59:40,271 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-06 15:59:40,275 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231006b6ede254749a4d53b0d52088a4ba7f26 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20231006b6ede254749a4d53b0d52088a4ba7f26 2023-10-06 15:59:40,277 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006ec1630f73716451e92d315e63378a43d to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231006ec1630f73716451e92d315e63378a43d 2023-10-06 15:59:40,277 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-06 15:59:40,280 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 15:59:40,300 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-06 15:59:40,303 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-06 15:59:40,305 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 15:59:40,305 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-06 15:59:40,305 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696607980305"}]},"ts":"9223372036854775807"} 2023-10-06 15:59:40,305 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696607980305"}]},"ts":"9223372036854775807"} 2023-10-06 15:59:40,309 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 15:59:40,309 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9c660a0b0fd98acb1d7f150e613ee6c8, NAME => 'testtb-testExportWithTargetName,,1696607964643.9c660a0b0fd98acb1d7f150e613ee6c8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2cb3cf1917c29233054002d2d95a9901, NAME => 'testtb-testExportWithTargetName,1,1696607964643.2cb3cf1917c29233054002d2d95a9901.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 15:59:40,309 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-06 15:59:40,309 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696607980309"}]},"ts":"9223372036854775807"} 2023-10-06 15:59:40,311 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-06 15:59:40,314 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-06 15:59:40,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 78 msec 2023-10-06 15:59:40,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-06 15:59:40,362 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-06 15:59:40,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-06 15:59:40,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-06 15:59:40,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-06 15:59:40,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-06 15:59:40,415 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 703) Potentially hanging thread: IPC Client (209246710) connection to jenkins-hbase4.apache.org/172.31.14.131:36173 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:36772 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:54308 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (209246710) connection to jenkins-hbase4.apache.org/172.31.14.131:36613 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (209246710) connection to jenkins-hbase4.apache.org/172.31.14.131:36879 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (209246710) connection to jenkins-hbase4.apache.org/172.31.14.131:39073 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1279 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1443270479_1 at /127.0.0.1:58242 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:58280 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=281 (was 276) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=2597 (was 3382) 2023-10-06 15:59:40,415 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-06 15:59:40,433 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=281, ProcessCount=167, AvailableMemoryMB=2596 2023-10-06 15:59:40,433 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-10-06 15:59:40,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 15:59:40,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-06 15:59:40,439 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 15:59:40,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-06 15:59:40,441 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 15:59:40,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 15:59:40,444 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:40,444 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:40,444 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620 empty. 2023-10-06 15:59:40,444 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58 empty. 2023-10-06 15:59:40,445 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:40,445 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:40,445 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-06 15:59:40,461 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-06 15:59:40,462 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 788f2e02b10d357c1f9d77e94dafbd58, NAME => 'testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 15:59:40,462 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => a81750d5012589a7d4dcafa257533620, NAME => 'testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 15:59:40,476 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:40,482 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 788f2e02b10d357c1f9d77e94dafbd58, disabling compactions & flushes 2023-10-06 15:59:40,482 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:40,482 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:40,482 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. after waiting 0 ms 2023-10-06 15:59:40,482 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:40,482 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:40,482 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 788f2e02b10d357c1f9d77e94dafbd58: 2023-10-06 15:59:40,484 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:40,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing a81750d5012589a7d4dcafa257533620, disabling compactions & flushes 2023-10-06 15:59:40,485 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:40,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:40,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. after waiting 0 ms 2023-10-06 15:59:40,485 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:40,486 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:40,486 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for a81750d5012589a7d4dcafa257533620: 2023-10-06 15:59:40,488 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 15:59:40,489 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696607980489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607980489"}]},"ts":"1696607980489"} 2023-10-06 15:59:40,490 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696607980489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607980489"}]},"ts":"1696607980489"} 2023-10-06 15:59:40,492 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 15:59:40,493 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 15:59:40,493 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607980493"}]},"ts":"1696607980493"} 2023-10-06 15:59:40,495 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-06 15:59:40,499 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 15:59:40,500 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 15:59:40,500 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 15:59:40,500 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 15:59:40,500 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 15:59:40,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a81750d5012589a7d4dcafa257533620, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=788f2e02b10d357c1f9d77e94dafbd58, ASSIGN}] 2023-10-06 15:59:40,502 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=788f2e02b10d357c1f9d77e94dafbd58, ASSIGN 2023-10-06 15:59:40,502 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a81750d5012589a7d4dcafa257533620, ASSIGN 2023-10-06 15:59:40,503 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=788f2e02b10d357c1f9d77e94dafbd58, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41607,1696607957421; forceNewPlan=false, retain=false 2023-10-06 15:59:40,503 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a81750d5012589a7d4dcafa257533620, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32989,1696607957469; forceNewPlan=false, retain=false 2023-10-06 15:59:40,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 15:59:40,654 INFO [jenkins-hbase4:45793] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 15:59:40,656 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=788f2e02b10d357c1f9d77e94dafbd58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:40,656 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a81750d5012589a7d4dcafa257533620, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:40,657 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696607980656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607980656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607980656"}]},"ts":"1696607980656"} 2023-10-06 15:59:40,657 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696607980656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607980656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607980656"}]},"ts":"1696607980656"} 2023-10-06 15:59:40,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 788f2e02b10d357c1f9d77e94dafbd58, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 15:59:40,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure a81750d5012589a7d4dcafa257533620, server=jenkins-hbase4.apache.org,32989,1696607957469}] 2023-10-06 15:59:40,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 15:59:40,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:40,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 788f2e02b10d357c1f9d77e94dafbd58, NAME => 'testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 15:59:40,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. service=AccessControlService 2023-10-06 15:59:40,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:40,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:40,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a81750d5012589a7d4dcafa257533620, NAME => 'testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 15:59:40,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:40,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:40,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:40,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:40,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. service=AccessControlService 2023-10-06 15:59:40,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:40,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:40,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:40,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:40,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:40,817 INFO [StoreOpener-788f2e02b10d357c1f9d77e94dafbd58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:40,818 INFO [StoreOpener-a81750d5012589a7d4dcafa257533620-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:40,819 DEBUG [StoreOpener-788f2e02b10d357c1f9d77e94dafbd58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/cf 2023-10-06 15:59:40,819 DEBUG [StoreOpener-788f2e02b10d357c1f9d77e94dafbd58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/cf 2023-10-06 15:59:40,819 DEBUG [StoreOpener-a81750d5012589a7d4dcafa257533620-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/cf 2023-10-06 15:59:40,819 DEBUG [StoreOpener-a81750d5012589a7d4dcafa257533620-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/cf 2023-10-06 15:59:40,819 INFO [StoreOpener-788f2e02b10d357c1f9d77e94dafbd58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 788f2e02b10d357c1f9d77e94dafbd58 columnFamilyName cf 2023-10-06 15:59:40,820 INFO [StoreOpener-a81750d5012589a7d4dcafa257533620-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a81750d5012589a7d4dcafa257533620 columnFamilyName cf 2023-10-06 15:59:40,821 INFO [StoreOpener-788f2e02b10d357c1f9d77e94dafbd58-1] regionserver.HStore(310): Store=788f2e02b10d357c1f9d77e94dafbd58/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:40,822 INFO [StoreOpener-a81750d5012589a7d4dcafa257533620-1] regionserver.HStore(310): Store=a81750d5012589a7d4dcafa257533620/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:40,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:40,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:40,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:40,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:40,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:40,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:40,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 15:59:40,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 15:59:40,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a81750d5012589a7d4dcafa257533620; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68036527, jitterRate=0.013823255896568298}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 15:59:40,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a81750d5012589a7d4dcafa257533620: 2023-10-06 15:59:40,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 788f2e02b10d357c1f9d77e94dafbd58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70702506, jitterRate=0.05354943871498108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 15:59:40,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 788f2e02b10d357c1f9d77e94dafbd58: 2023-10-06 15:59:40,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620., pid=31, masterSystemTime=1696607980812 2023-10-06 15:59:40,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58., pid=30, masterSystemTime=1696607980811 2023-10-06 15:59:40,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:40,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:40,836 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a81750d5012589a7d4dcafa257533620, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:40,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:40,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:40,836 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696607980836"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696607980836"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696607980836"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696607980836"}]},"ts":"1696607980836"} 2023-10-06 15:59:40,837 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=788f2e02b10d357c1f9d77e94dafbd58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:40,837 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696607980836"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696607980836"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696607980836"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696607980836"}]},"ts":"1696607980836"} 2023-10-06 15:59:40,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-06 15:59:40,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure a81750d5012589a7d4dcafa257533620, server=jenkins-hbase4.apache.org,32989,1696607957469 in 178 msec 2023-10-06 15:59:40,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-10-06 15:59:40,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 788f2e02b10d357c1f9d77e94dafbd58, server=jenkins-hbase4.apache.org,41607,1696607957421 in 181 msec 2023-10-06 15:59:40,846 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a81750d5012589a7d4dcafa257533620, ASSIGN in 343 msec 2023-10-06 15:59:40,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-06 15:59:40,849 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=788f2e02b10d357c1f9d77e94dafbd58, ASSIGN in 345 msec 2023-10-06 15:59:40,850 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 15:59:40,850 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607980850"}]},"ts":"1696607980850"} 2023-10-06 15:59:40,852 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-06 15:59:40,854 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 15:59:40,855 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-06 15:59:40,857 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 15:59:40,858 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:40,858 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:40,859 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:40,859 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:40,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:40,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:40,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:40,861 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:40,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 424 msec 2023-10-06 15:59:41,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-06 15:59:41,045 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-06 15:59:41,049 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-06 15:59:41,049 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:41,051 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 15:59:41,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 15:59:41,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696607981072 (current time:1696607981072). 2023-10-06 15:59:41,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 15:59:41,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x521de763 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:41,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29f6b76b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:41,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:41,085 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:41,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x521de763 to 127.0.0.1:55741 2023-10-06 15:59:41,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:41,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x3e125d3e to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:41,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3098360, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:41,094 DEBUG [hconnection-0x1fd82185-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:41,095 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:41,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e125d3e to 127.0.0.1:55741 2023-10-06 15:59:41,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:41,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 15:59:41,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 15:59:41,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 15:59:41,104 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 15:59:41,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 15:59:41,106 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 15:59:41,107 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696608581107 2023-10-06 15:59:41,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 15:59:41,107 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-06 15:59:41,108 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 15:59:41,109 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 15:59:41,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 15:59:41,110 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 15:59:41,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-06 15:59:41,112 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 15:59:41,113 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696608581113 2023-10-06 15:59:41,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,125 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-06 15:59:41,125 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:41,127 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-06 15:59:41,127 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-06 15:59:41,127 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,127 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,129 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,129 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,129 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,129 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,130 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,130 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,131 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,131 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,131 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 15:59:41,132 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 15:59:41,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,132 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:41,132 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 15:59:41,133 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 15:59:41,133 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-06 15:59:41,133 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:41,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,134 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 15:59:41,134 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 15:59:41,133 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-06 15:59:41,134 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:41,134 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-06 15:59:41,135 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-06 15:59:41,135 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 15:59:41,136 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-06 15:59:41,136 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-06 15:59:41,137 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:41,147 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,147 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:41,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-06 15:59:41,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52546d1f[Count = 1] remaining members to acquire global barrier 2023-10-06 15:59:41,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:41,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-06 15:59:41,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52546d1f[Count = 0] remaining members to acquire global barrier 2023-10-06 15:59:41,152 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 15:59:41,152 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,153 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,153 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,153 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,153 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 15:59:41,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,153 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-06 15:59:41,153 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 15:59:41,153 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,153 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 15:59:41,153 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 15:59:41,154 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:41,154 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:41,154 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:41,154 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,154 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:41,154 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 15:59:41,154 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. started... 2023-10-06 15:59:41,154 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:41,154 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:41,154 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. started... 2023-10-06 15:59:41,154 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a81750d5012589a7d4dcafa257533620: 2023-10-06 15:59:41,155 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 788f2e02b10d357c1f9d77e94dafbd58: 2023-10-06 15:59:41,155 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,155 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:41,155 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 15:59:41,156 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,156 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:41,156 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 15:59:41,156 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-06 15:59:41,156 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:41,157 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 15:59:41,179 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. completed. 2023-10-06 15:59:41,179 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:41,179 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:41,179 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:41,179 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,179 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-06 15:59:41,179 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 15:59:41,181 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. completed. 2023-10-06 15:59:41,181 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:41,181 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:41,181 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:41,181 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,182 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-06 15:59:41,182 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 15:59:41,182 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,182 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 15:59:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:41,182 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:41,182 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-06 15:59:41,184 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,184 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 15:59:41,184 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:41,184 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-06 15:59:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:41,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41607,1696607957421': 2023-10-06 15:59:41,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 15:59:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,32989,1696607957469': 2023-10-06 15:59:41,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 15:59:41,193 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-06 15:59:41,193 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 15:59:41,193 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 15:59:41,193 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,193 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 15:59:41,195 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,195 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:41,195 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,195 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,195 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,195 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,195 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:41,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,196 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,196 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,197 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:41,198 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,199 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,199 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,203 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,203 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,203 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,203 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,203 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,203 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,203 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,203 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,203 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,204 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,204 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,204 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,204 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,204 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,204 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,204 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,204 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:41,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,204 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-06 15:59:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 15:59:41,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 15:59:41,209 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:41,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 15:59:41,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 15:59:41,210 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 15:59:41,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,256 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-06 15:59:41,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,257 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:41,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696607981108Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696607981223 (+115 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696607981223Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696607981223Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696607981228 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696607981248 (+20 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696607981256 (+8 ms) 2023-10-06 15:59:41,259 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 15:59:41,261 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 151 msec 2023-10-06 15:59:41,410 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:41,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 15:59:41,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 15:59:41,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32989] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 15:59:41,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41607] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 15:59:41,424 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-06 15:59:41,424 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:41,425 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 15:59:41,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 15:59:41,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696607981436 (current time:1696607981436). 2023-10-06 15:59:41,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 15:59:41,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x04765e8e to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:41,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@287b43e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:41,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:41,450 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:41,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04765e8e to 127.0.0.1:55741 2023-10-06 15:59:41,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:41,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x437282a4 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:41,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7501768, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:41,459 DEBUG [hconnection-0x7a2aa112-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:41,461 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:41,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x437282a4 to 127.0.0.1:55741 2023-10-06 15:59:41,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:41,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 15:59:41,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 15:59:41,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 15:59:41,472 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 15:59:41,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 15:59:41,475 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 15:59:41,476 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696608581476 2023-10-06 15:59:41,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 15:59:41,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-06 15:59:41,477 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 15:59:41,477 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 15:59:41,479 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-06 15:59:41,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 15:59:41,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-06 15:59:41,481 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 15:59:41,481 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696608581481 2023-10-06 15:59:41,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-06 15:59:41,492 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-06 15:59:41,492 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:41,493 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-06 15:59:41,493 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-06 15:59:41,494 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,494 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,495 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,495 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,495 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,495 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,496 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,496 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,496 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,496 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-06 15:59:41,497 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 15:59:41,498 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 15:59:41,498 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:41,498 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:41,497 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-06 15:59:41,499 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 15:59:41,499 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-06 15:59:41,498 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 15:59:41,499 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-06 15:59:41,499 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-06 15:59:41,499 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-06 15:59:41,499 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-06 15:59:41,499 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:41,499 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-06 15:59:41,500 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-06 15:59:41,500 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-06 15:59:41,500 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-06 15:59:41,502 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,502 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:41,503 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:41,503 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:41,504 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,504 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:41,504 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:41,504 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:41,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 15:59:41,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:41,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-06 15:59:41,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3076ffc4[Count = 1] remaining members to acquire global barrier 2023-10-06 15:59:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:41,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 15:59:41,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:41,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-06 15:59:41,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3076ffc4[Count = 0] remaining members to acquire global barrier 2023-10-06 15:59:41,508 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 15:59:41,508 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,509 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,509 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,509 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,509 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 15:59:41,509 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-06 15:59:41,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 15:59:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 15:59:41,510 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,510 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 15:59:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-06 15:59:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:41,510 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:41,510 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:41,510 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. started... 2023-10-06 15:59:41,510 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. started... 2023-10-06 15:59:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:41,510 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:41,510 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a81750d5012589a7d4dcafa257533620 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-06 15:59:41,511 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 788f2e02b10d357c1f9d77e94dafbd58 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-06 15:59:41,511 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 15:59:41,511 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:41,511 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-06 15:59:41,541 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006d436d8e57d234df584d2075ec046d019 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006d436d8e57d234df584d2075ec046d019 2023-10-06 15:59:41,546 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231006797a57672bab4764ac3711bdbde017a7 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231006797a57672bab4764ac3711bdbde017a7 2023-10-06 15:59:41,553 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/.tmp/cf/82bb1b45ad02455283501c38cde11790 2023-10-06 15:59:41,561 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/.tmp/cf/82bb1b45ad02455283501c38cde11790 as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/cf/82bb1b45ad02455283501c38cde11790 2023-10-06 15:59:41,567 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/cf/82bb1b45ad02455283501c38cde11790, entries=3, sequenceid=6, filesize=5.4 K 2023-10-06 15:59:41,572 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for a81750d5012589a7d4dcafa257533620 in 62ms, sequenceid=6, compaction requested=false 2023-10-06 15:59:41,572 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-06 15:59:41,573 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/.tmp/cf/3cb9245c535b4959b8978cbf0d3092ba 2023-10-06 15:59:41,573 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a81750d5012589a7d4dcafa257533620: 2023-10-06 15:59:41,573 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-06 15:59:41,573 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:41,573 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/cf/82bb1b45ad02455283501c38cde11790] hfiles 2023-10-06 15:59:41,573 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/cf/82bb1b45ad02455283501c38cde11790 for snapshot=snaptb0-testExportFileSystemState 2023-10-06 15:59:41,578 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:41,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 15:59:41,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 15:59:41,579 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 15:59:41,584 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/.tmp/cf/3cb9245c535b4959b8978cbf0d3092ba as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/cf/3cb9245c535b4959b8978cbf0d3092ba 2023-10-06 15:59:41,585 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. completed. 2023-10-06 15:59:41,585 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:41,586 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:41,586 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:41,586 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,586 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-06 15:59:41,586 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 15:59:41,592 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,592 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 15:59:41,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,592 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:41,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:41,592 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-06 15:59:41,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:41,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:41,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:41,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 15:59:41,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:41,596 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/cf/3cb9245c535b4959b8978cbf0d3092ba, entries=47, sequenceid=6, filesize=12.8 K 2023-10-06 15:59:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 15:59:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,597 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 788f2e02b10d357c1f9d77e94dafbd58 in 87ms, sequenceid=6, compaction requested=false 2023-10-06 15:59:41,599 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 788f2e02b10d357c1f9d77e94dafbd58: 2023-10-06 15:59:41,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,32989,1696607957469': 2023-10-06 15:59:41,599 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-06 15:59:41,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 15:59:41,599 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:41,599 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/cf/3cb9245c535b4959b8978cbf0d3092ba] hfiles 2023-10-06 15:59:41,599 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/cf/3cb9245c535b4959b8978cbf0d3092ba for snapshot=snaptb0-testExportFileSystemState 2023-10-06 15:59:41,613 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. completed. 2023-10-06 15:59:41,613 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:41,613 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:41,613 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:41,614 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,614 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-06 15:59:41,614 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 15:59:41,615 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,615 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-06 15:59:41,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:41,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:41,615 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:41,616 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-06 15:59:41,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:41,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:41,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 15:59:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 15:59:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41607,1696607957421': 2023-10-06 15:59:41,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 15:59:41,620 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-06 15:59:41,620 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 15:59:41,620 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 15:59:41,620 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-06 15:59:41,620 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 15:59:41,622 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,622 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:41,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:41,622 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,622 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,622 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,623 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,622 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:41,623 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,623 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 15:59:41,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,624 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 15:59:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:41,625 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-06 15:59:41,626 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,626 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,629 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,629 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,629 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,629 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:41,629 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,629 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,630 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-06 15:59:41,630 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,630 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-06 15:59:41,629 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:41,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-06 15:59:41,629 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:41,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 15:59:41,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:41,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:41,630 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,631 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,631 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,631 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:41,631 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,631 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:41,631 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:41,631 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,632 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:41,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231006797a57672bab4764ac3711bdbde017a7, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006d436d8e57d234df584d2075ec046d019] mob files 2023-10-06 15:59:41,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:41,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231006797a57672bab4764ac3711bdbde017a7 2023-10-06 15:59:41,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006d436d8e57d234df584d2075ec046d019 2023-10-06 15:59:41,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-06 15:59:41,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-06 15:59:41,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,668 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696607981476Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696607981644 (+168 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696607981644Loading Region manifests for snaptb0-testExportFileSystemState at 1696607981644Writing data manifest for snaptb0-testExportFileSystemState at 1696607981648 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696607981658 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696607981668 (+10 ms) 2023-10-06 15:59:41,671 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-06 15:59:41,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 194 msec 2023-10-06 15:59:41,779 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:41,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 15:59:41,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 15:59:41,781 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607981781 2023-10-06 15:59:41,781 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34141, tgtDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607981781, rawTgtDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607981781, srcFsUri=hdfs://localhost:34141, srcDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 15:59:41,804 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 15:59:41,804 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1349957538_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607981781, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607981781/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,804 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca, snapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-06 15:59:41,815 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607981781/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-06 15:59:41,849 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,849 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,850 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,850 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,920 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/hadoop-6639770096218915419.jar 2023-10-06 15:59:41,921 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,921 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,922 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,922 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,922 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,923 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:41,923 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.5/hbase-shaded-miscellaneous-4.1.5.jar 2023-10-06 15:59:41,924 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.5/hbase-shaded-gson-4.1.5.jar 2023-10-06 15:59:41,924 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.5/hbase-shaded-protobuf-4.1.5.jar 2023-10-06 15:59:41,924 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.5/hbase-shaded-netty-4.1.5.jar 2023-10-06 15:59:41,925 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.5/hbase-unsafe-4.1.5.jar 2023-10-06 15:59:41,925 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 15:59:41,926 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 15:59:41,926 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 15:59:41,926 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 15:59:41,927 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 15:59:41,927 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:41,927 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:41,928 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 15:59:41,928 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:41,928 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:41,929 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 15:59:41,929 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 15:59:42,384 WARN [Listener at jenkins-hbase4.apache.org/39073] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 15:59:42,387 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-06 15:59:42,389 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-06 15:59:44,546 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 15:59:44,546 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 15:59:44,552 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0001_000001 (auth:SIMPLE) 2023-10-06 15:59:45,323 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0002_000001 (auth:SIMPLE) 2023-10-06 15:59:45,715 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 15:59:49,209 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0002_000001 (auth:SIMPLE) 2023-10-06 15:59:51,433 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0002_000001 (auth:SIMPLE) 2023-10-06 15:59:54,044 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0002_000001 (auth:SIMPLE) 2023-10-06 15:59:55,584 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 15:59:55,585 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 15:59:55,594 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-06 15:59:55,594 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 15:59:55,595 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 15:59:55,595 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-06 15:59:55,595 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-06 15:59:55,595 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-06 15:59:55,595 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607981781/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607981781/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-06 15:59:55,596 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607981781/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-06 15:59:55,596 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696607981781/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-06 15:59:55,603 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-06 15:59:55,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-06 15:59:55,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-06 15:59:55,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-06 15:59:55,609 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607995609"}]},"ts":"1696607995609"} 2023-10-06 15:59:55,611 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-06 15:59:55,613 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-06 15:59:55,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a81750d5012589a7d4dcafa257533620, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=788f2e02b10d357c1f9d77e94dafbd58, UNASSIGN}] 2023-10-06 15:59:55,616 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=788f2e02b10d357c1f9d77e94dafbd58, UNASSIGN 2023-10-06 15:59:55,617 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a81750d5012589a7d4dcafa257533620, UNASSIGN 2023-10-06 15:59:55,617 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=788f2e02b10d357c1f9d77e94dafbd58, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:55,617 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696607995617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607995617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607995617"}]},"ts":"1696607995617"} 2023-10-06 15:59:55,618 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a81750d5012589a7d4dcafa257533620, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:55,618 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696607995617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607995617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607995617"}]},"ts":"1696607995617"} 2023-10-06 15:59:55,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 788f2e02b10d357c1f9d77e94dafbd58, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 15:59:55,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure a81750d5012589a7d4dcafa257533620, server=jenkins-hbase4.apache.org,32989,1696607957469}] 2023-10-06 15:59:55,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-06 15:59:55,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:55,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 788f2e02b10d357c1f9d77e94dafbd58, disabling compactions & flushes 2023-10-06 15:59:55,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:55,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:55,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. after waiting 0 ms 2023-10-06 15:59:55,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:55,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:55,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a81750d5012589a7d4dcafa257533620, disabling compactions & flushes 2023-10-06 15:59:55,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:55,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:55,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. after waiting 0 ms 2023-10-06 15:59:55,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:55,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 15:59:55,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 15:59:55,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 15:59:55,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58. 2023-10-06 15:59:55,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 788f2e02b10d357c1f9d77e94dafbd58: 2023-10-06 15:59:55,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 15:59:55,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620. 2023-10-06 15:59:55,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a81750d5012589a7d4dcafa257533620: 2023-10-06 15:59:55,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:55,786 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=788f2e02b10d357c1f9d77e94dafbd58, regionState=CLOSED 2023-10-06 15:59:55,786 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696607995786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607995786"}]},"ts":"1696607995786"} 2023-10-06 15:59:55,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:55,787 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a81750d5012589a7d4dcafa257533620, regionState=CLOSED 2023-10-06 15:59:55,787 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696607995787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607995787"}]},"ts":"1696607995787"} 2023-10-06 15:59:55,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-10-06 15:59:55,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 788f2e02b10d357c1f9d77e94dafbd58, server=jenkins-hbase4.apache.org,41607,1696607957421 in 169 msec 2023-10-06 15:59:55,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-10-06 15:59:55,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure a81750d5012589a7d4dcafa257533620, server=jenkins-hbase4.apache.org,32989,1696607957469 in 169 msec 2023-10-06 15:59:55,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=788f2e02b10d357c1f9d77e94dafbd58, UNASSIGN in 176 msec 2023-10-06 15:59:55,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-06 15:59:55,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a81750d5012589a7d4dcafa257533620, UNASSIGN in 177 msec 2023-10-06 15:59:55,794 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607995794"}]},"ts":"1696607995794"} 2023-10-06 15:59:55,795 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-06 15:59:55,797 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-06 15:59:55,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 194 msec 2023-10-06 15:59:55,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-06 15:59:55,911 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-06 15:59:55,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-06 15:59:55,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 15:59:55,916 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 15:59:55,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-06 15:59:55,917 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 15:59:55,919 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-06 15:59:55,923 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:55,924 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:55,926 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/recovered.edits] 2023-10-06 15:59:55,927 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/recovered.edits] 2023-10-06 15:59:55,931 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/cf/82bb1b45ad02455283501c38cde11790 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/cf/82bb1b45ad02455283501c38cde11790 2023-10-06 15:59:55,932 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/cf/3cb9245c535b4959b8978cbf0d3092ba to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/cf/3cb9245c535b4959b8978cbf0d3092ba 2023-10-06 15:59:55,932 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 15:59:55,932 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 15:59:55,932 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 15:59:55,932 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 15:59:55,933 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 15:59:55,933 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 15:59:55,933 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 15:59:55,933 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-06 15:59:55,935 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620/recovered.edits/9.seqid 2023-10-06 15:59:55,936 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/a81750d5012589a7d4dcafa257533620 2023-10-06 15:59:55,937 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58/recovered.edits/9.seqid 2023-10-06 15:59:55,937 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemState/788f2e02b10d357c1f9d77e94dafbd58 2023-10-06 15:59:55,937 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-06 15:59:55,938 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-06 15:59:55,939 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-06 15:59:55,939 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 15:59:55,939 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 15:59:55,940 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:55,940 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 15:59:55,940 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-06 15:59:55,940 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:55,940 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:55,940 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:55,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-06 15:59:55,945 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231006797a57672bab4764ac3711bdbde017a7 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231006797a57672bab4764ac3711bdbde017a7 2023-10-06 15:59:55,946 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006d436d8e57d234df584d2075ec046d019 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20231006d436d8e57d234df584d2075ec046d019 2023-10-06 15:59:55,947 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-06 15:59:55,950 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 15:59:55,953 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-06 15:59:55,955 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-06 15:59:55,957 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 15:59:55,957 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-06 15:59:55,957 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696607995957"}]},"ts":"9223372036854775807"} 2023-10-06 15:59:55,957 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696607995957"}]},"ts":"9223372036854775807"} 2023-10-06 15:59:55,961 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 15:59:55,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a81750d5012589a7d4dcafa257533620, NAME => 'testtb-testExportFileSystemState,,1696607980435.a81750d5012589a7d4dcafa257533620.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 788f2e02b10d357c1f9d77e94dafbd58, NAME => 'testtb-testExportFileSystemState,1,1696607980435.788f2e02b10d357c1f9d77e94dafbd58.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 15:59:55,962 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-06 15:59:55,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696607995962"}]},"ts":"9223372036854775807"} 2023-10-06 15:59:55,964 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-06 15:59:55,967 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-06 15:59:55,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 55 msec 2023-10-06 15:59:56,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-06 15:59:56,043 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-06 15:59:56,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-06 15:59:56,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-06 15:59:56,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-06 15:59:56,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-06 15:59:56,083 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 753) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2079 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:52758 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1636342089_1 at /127.0.0.1:44112 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (209246710) connection to jenkins-hbase4.apache.org/172.31.14.131:45531 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:41348 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1636342089_1 at /127.0.0.1:37928 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:32888 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=285 (was 281) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 167), AvailableMemoryMB=2486 (was 2596) 2023-10-06 15:59:56,084 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-06 15:59:56,103 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=285, ProcessCount=166, AvailableMemoryMB=2483 2023-10-06 15:59:56,103 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-10-06 15:59:56,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 15:59:56,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-06 15:59:56,109 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 15:59:56,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-06 15:59:56,110 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 15:59:56,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 15:59:56,112 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde 2023-10-06 15:59:56,113 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde empty. 2023-10-06 15:59:56,113 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952 2023-10-06 15:59:56,114 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde 2023-10-06 15:59:56,114 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952 empty. 2023-10-06 15:59:56,114 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952 2023-10-06 15:59:56,114 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-06 15:59:56,129 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-06 15:59:56,130 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 42d00c9337cdd43328f22e16467edcde, NAME => 'testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 15:59:56,133 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5d2663940cd144e4274883f8a13a7952, NAME => 'testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 15:59:56,151 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:56,151 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 5d2663940cd144e4274883f8a13a7952, disabling compactions & flushes 2023-10-06 15:59:56,151 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 15:59:56,151 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 15:59:56,151 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. after waiting 0 ms 2023-10-06 15:59:56,151 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 15:59:56,151 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 15:59:56,151 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 5d2663940cd144e4274883f8a13a7952: 2023-10-06 15:59:56,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 15:59:56,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 15:59:56,547 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:56,548 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 42d00c9337cdd43328f22e16467edcde, disabling compactions & flushes 2023-10-06 15:59:56,548 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:56,548 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:56,548 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. after waiting 0 ms 2023-10-06 15:59:56,548 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:56,548 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:56,548 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 42d00c9337cdd43328f22e16467edcde: 2023-10-06 15:59:56,550 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 15:59:56,551 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696607996551"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607996551"}]},"ts":"1696607996551"} 2023-10-06 15:59:56,551 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696607996551"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696607996551"}]},"ts":"1696607996551"} 2023-10-06 15:59:56,554 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 15:59:56,555 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 15:59:56,555 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607996555"}]},"ts":"1696607996555"} 2023-10-06 15:59:56,556 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-06 15:59:56,559 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 15:59:56,560 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 15:59:56,560 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 15:59:56,560 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 15:59:56,561 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 15:59:56,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42d00c9337cdd43328f22e16467edcde, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d2663940cd144e4274883f8a13a7952, ASSIGN}] 2023-10-06 15:59:56,564 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d2663940cd144e4274883f8a13a7952, ASSIGN 2023-10-06 15:59:56,564 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42d00c9337cdd43328f22e16467edcde, ASSIGN 2023-10-06 15:59:56,565 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d2663940cd144e4274883f8a13a7952, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41607,1696607957421; forceNewPlan=false, retain=false 2023-10-06 15:59:56,565 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42d00c9337cdd43328f22e16467edcde, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32989,1696607957469; forceNewPlan=false, retain=false 2023-10-06 15:59:56,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 15:59:56,715 INFO [jenkins-hbase4:45793] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 15:59:56,718 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=42d00c9337cdd43328f22e16467edcde, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:56,718 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5d2663940cd144e4274883f8a13a7952, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:56,718 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696607996718"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607996718"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607996718"}]},"ts":"1696607996718"} 2023-10-06 15:59:56,718 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696607996718"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696607996718"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696607996718"}]},"ts":"1696607996718"} 2023-10-06 15:59:56,720 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 42d00c9337cdd43328f22e16467edcde, server=jenkins-hbase4.apache.org,32989,1696607957469}] 2023-10-06 15:59:56,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 5d2663940cd144e4274883f8a13a7952, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 15:59:56,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:56,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 42d00c9337cdd43328f22e16467edcde, NAME => 'testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 15:59:56,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 15:59:56,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d2663940cd144e4274883f8a13a7952, NAME => 'testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 15:59:56,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. service=AccessControlService 2023-10-06 15:59:56,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. service=AccessControlService 2023-10-06 15:59:56,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:56,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 15:59:56,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 42d00c9337cdd43328f22e16467edcde 2023-10-06 15:59:56,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5d2663940cd144e4274883f8a13a7952 2023-10-06 15:59:56,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:56,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 15:59:56,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 42d00c9337cdd43328f22e16467edcde 2023-10-06 15:59:56,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5d2663940cd144e4274883f8a13a7952 2023-10-06 15:59:56,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 42d00c9337cdd43328f22e16467edcde 2023-10-06 15:59:56,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5d2663940cd144e4274883f8a13a7952 2023-10-06 15:59:56,878 INFO [StoreOpener-42d00c9337cdd43328f22e16467edcde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 42d00c9337cdd43328f22e16467edcde 2023-10-06 15:59:56,878 INFO [StoreOpener-5d2663940cd144e4274883f8a13a7952-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5d2663940cd144e4274883f8a13a7952 2023-10-06 15:59:56,880 DEBUG [StoreOpener-5d2663940cd144e4274883f8a13a7952-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/cf 2023-10-06 15:59:56,880 DEBUG [StoreOpener-42d00c9337cdd43328f22e16467edcde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/cf 2023-10-06 15:59:56,880 DEBUG [StoreOpener-5d2663940cd144e4274883f8a13a7952-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/cf 2023-10-06 15:59:56,880 DEBUG [StoreOpener-42d00c9337cdd43328f22e16467edcde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/cf 2023-10-06 15:59:56,880 INFO [StoreOpener-42d00c9337cdd43328f22e16467edcde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42d00c9337cdd43328f22e16467edcde columnFamilyName cf 2023-10-06 15:59:56,880 INFO [StoreOpener-5d2663940cd144e4274883f8a13a7952-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d2663940cd144e4274883f8a13a7952 columnFamilyName cf 2023-10-06 15:59:56,882 INFO [StoreOpener-5d2663940cd144e4274883f8a13a7952-1] regionserver.HStore(310): Store=5d2663940cd144e4274883f8a13a7952/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:56,882 INFO [StoreOpener-42d00c9337cdd43328f22e16467edcde-1] regionserver.HStore(310): Store=42d00c9337cdd43328f22e16467edcde/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 15:59:56,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952 2023-10-06 15:59:56,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde 2023-10-06 15:59:56,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952 2023-10-06 15:59:56,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde 2023-10-06 15:59:56,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 42d00c9337cdd43328f22e16467edcde 2023-10-06 15:59:56,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5d2663940cd144e4274883f8a13a7952 2023-10-06 15:59:56,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 15:59:56,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 42d00c9337cdd43328f22e16467edcde; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59296023, jitterRate=-0.11642040312290192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 15:59:56,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 42d00c9337cdd43328f22e16467edcde: 2023-10-06 15:59:56,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde., pid=45, masterSystemTime=1696607996872 2023-10-06 15:59:56,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 15:59:56,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:56,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:56,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5d2663940cd144e4274883f8a13a7952; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74308203, jitterRate=0.10727851092815399}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 15:59:56,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5d2663940cd144e4274883f8a13a7952: 2023-10-06 15:59:56,893 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=42d00c9337cdd43328f22e16467edcde, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:56,893 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696607996893"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696607996893"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696607996893"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696607996893"}]},"ts":"1696607996893"} 2023-10-06 15:59:56,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952., pid=46, masterSystemTime=1696607996873 2023-10-06 15:59:56,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 15:59:56,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 15:59:56,896 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5d2663940cd144e4274883f8a13a7952, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:56,896 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696607996896"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696607996896"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696607996896"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696607996896"}]},"ts":"1696607996896"} 2023-10-06 15:59:56,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-06 15:59:56,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 42d00c9337cdd43328f22e16467edcde, server=jenkins-hbase4.apache.org,32989,1696607957469 in 177 msec 2023-10-06 15:59:56,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-06 15:59:56,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 5d2663940cd144e4274883f8a13a7952, server=jenkins-hbase4.apache.org,41607,1696607957421 in 177 msec 2023-10-06 15:59:56,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42d00c9337cdd43328f22e16467edcde, ASSIGN in 339 msec 2023-10-06 15:59:56,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-10-06 15:59:56,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d2663940cd144e4274883f8a13a7952, ASSIGN in 340 msec 2023-10-06 15:59:56,904 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 15:59:56,904 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696607996904"}]},"ts":"1696607996904"} 2023-10-06 15:59:56,905 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-06 15:59:56,909 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 15:59:56,909 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-06 15:59:56,911 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-06 15:59:56,912 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:56,912 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:56,912 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:56,912 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 15:59:56,914 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:56,914 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:56,914 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:56,914 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-06 15:59:56,915 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 809 msec 2023-10-06 15:59:57,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-06 15:59:57,216 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-06 15:59:57,218 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-06 15:59:57,218 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:57,220 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 15:59:57,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 15:59:57,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696607997231 (current time:1696607997231). 2023-10-06 15:59:57,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 15:59:57,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x13a9dcd0 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:57,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6996112a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:57,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:57,241 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:57,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13a9dcd0 to 127.0.0.1:55741 2023-10-06 15:59:57,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:57,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x4eb95a95 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:57,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@132b40ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:57,252 DEBUG [hconnection-0x4aed0cc0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:57,255 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:57,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4eb95a95 to 127.0.0.1:55741 2023-10-06 15:59:57,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:57,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-06 15:59:57,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 15:59:57,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 15:59:57,263 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 15:59:57,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 15:59:57,265 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 15:59:57,266 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696608597266 2023-10-06 15:59:57,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 15:59:57,266 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-06 15:59:57,267 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 15:59:57,267 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 15:59:57,268 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 15:59:57,271 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 15:59:57,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-10-06 15:59:57,273 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 15:59:57,273 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696608597273 2023-10-06 15:59:57,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,285 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-06 15:59:57,285 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:57,286 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-06 15:59:57,286 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-06 15:59:57,287 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,287 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,288 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,288 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,288 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,289 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,289 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,289 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,289 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 15:59:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-06 15:59:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-06 15:59:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,290 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 15:59:57,290 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 15:59:57,290 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,290 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 15:59:57,290 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:57,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,290 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 15:59:57,290 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:57,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-06 15:59:57,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,291 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 15:59:57,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,292 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 15:59:57,292 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 15:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 15:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-06 15:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-06 15:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 15:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-06 15:59:57,297 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-06 15:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-06 15:59:57,296 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-06 15:59:57,303 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,304 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,304 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,304 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,304 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,304 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:57,304 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:57,304 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:57,304 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:57,304 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,304 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:57,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-06 15:59:57,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2914478e[Count = 1] remaining members to acquire global barrier 2023-10-06 15:59:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:57,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-06 15:59:57,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2914478e[Count = 0] remaining members to acquire global barrier 2023-10-06 15:59:57,310 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-06 15:59:57,310 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,311 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,311 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,311 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,311 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 15:59:57,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,312 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,312 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 15:59:57,312 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:57,312 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:57,312 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. started... 2023-10-06 15:59:57,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,312 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,312 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 15:59:57,312 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 15:59:57,312 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:57,312 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:57,313 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. started... 2023-10-06 15:59:57,312 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42d00c9337cdd43328f22e16467edcde: 2023-10-06 15:59:57,312 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 15:59:57,313 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:57,314 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5d2663940cd144e4274883f8a13a7952: 2023-10-06 15:59:57,314 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,314 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-06 15:59:57,314 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:57,314 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,314 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 15:59:57,315 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:57,314 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 15:59:57,315 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 15:59:57,326 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 15:59:57,326 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:57,326 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-06 15:59:57,340 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. completed. 2023-10-06 15:59:57,340 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 15:59:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-06 15:59:57,341 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 15:59:57,343 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 15:59:57,343 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:57,343 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-06 15:59:57,345 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,345 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. completed. 2023-10-06 15:59:57,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:57,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:57,345 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:57,345 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:57,345 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:57,345 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,346 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-06 15:59:57,346 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 15:59:57,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:57,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:57,348 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,348 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 15:59:57,348 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:57,348 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-06 15:59:57,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:57,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41607,1696607957421': 2023-10-06 15:59:57,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-06 15:59:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:57,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,32989,1696607957469': 2023-10-06 15:59:57,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-06 15:59:57,357 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-06 15:59:57,358 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 15:59:57,358 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 15:59:57,358 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,358 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 15:59:57,359 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,359 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,359 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,360 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,359 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:57,360 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:57,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,360 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:57,361 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,362 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:57,362 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:57,364 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,364 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,364 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,367 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:57,368 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 15:59:57,368 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-06 15:59:57,368 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,369 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,369 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-06 15:59:57,369 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:57,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,369 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 15:59:57,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,369 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,369 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,369 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 15:59:57,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,372 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,372 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,372 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,372 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,372 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 15:59:57,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,404 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-06 15:59:57,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,404 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-06 15:59:57,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696607997266Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696607997380 (+114 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696607997380Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696607997380Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696607997386 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696607997397 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696607997404 (+7 ms) 2023-10-06 15:59:57,407 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 15:59:57,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 140 msec 2023-10-06 15:59:57,571 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:57,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 15:59:57,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 15:59:57,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32989] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 15:59:57,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41607] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 15:59:57,580 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-06 15:59:57,580 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:57,580 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 15:59:57,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 15:59:57,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696607997590 (current time:1696607997590). 2023-10-06 15:59:57,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 15:59:57,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x1159d2cd to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:57,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35586f13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:57,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:57,606 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:57,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1159d2cd to 127.0.0.1:55741 2023-10-06 15:59:57,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:57,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x0e8016ae to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 15:59:57,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51906209, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 15:59:57,616 DEBUG [hconnection-0x2746afdf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 15:59:57,616 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 15:59:57,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e8016ae to 127.0.0.1:55741 2023-10-06 15:59:57,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 15:59:57,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-06 15:59:57,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 15:59:57,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 15:59:57,624 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 15:59:57,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 15:59:57,627 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 15:59:57,628 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696608597628 2023-10-06 15:59:57,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-06 15:59:57,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-06 15:59:57,629 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 15:59:57,629 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 15:59:57,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 15:59:57,630 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-06 15:59:57,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-06 15:59:57,637 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 15:59:57,637 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696608597637 2023-10-06 15:59:57,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-06 15:59:57,653 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-06 15:59:57,653 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:57,654 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-06 15:59:57,654 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-06 15:59:57,655 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,655 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,656 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,656 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,656 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,656 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,657 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,657 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,657 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,657 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 15:59:57,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-06 15:59:57,658 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 15:59:57,658 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 15:59:57,658 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:57,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-06 15:59:57,660 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 15:59:57,660 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-06 15:59:57,658 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:57,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-06 15:59:57,661 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 15:59:57,661 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-06 15:59:57,661 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 15:59:57,660 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-06 15:59:57,662 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-06 15:59:57,662 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-06 15:59:57,662 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-06 15:59:57,661 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-06 15:59:57,662 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-06 15:59:57,663 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,663 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:57,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:57,663 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,663 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,664 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:57,664 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,664 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:57,664 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,665 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:57,664 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,665 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 15:59:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 15:59:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:57,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-06 15:59:57,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7df757ce[Count = 1] remaining members to acquire global barrier 2023-10-06 15:59:57,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:57,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:57,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:57,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 15:59:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:57,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-06 15:59:57,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7df757ce[Count = 0] remaining members to acquire global barrier 2023-10-06 15:59:57,669 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-06 15:59:57,669 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,671 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,671 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,671 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,672 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 15:59:57,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,672 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 15:59:57,672 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-06 15:59:57,672 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-06 15:59:57,672 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 15:59:57,672 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,672 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 15:59:57,672 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:57,672 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:57,672 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 15:59:57,673 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:57,673 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 15:59:57,673 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. started... 2023-10-06 15:59:57,673 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,673 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 15:59:57,673 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 42d00c9337cdd43328f22e16467edcde 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-06 15:59:57,674 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. started... 2023-10-06 15:59:57,674 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5d2663940cd144e4274883f8a13a7952 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-06 15:59:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 15:59:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:57,675 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-06 15:59:57,703 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006677a0f46fdc84b4993f1609ac4bef60a to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231006677a0f46fdc84b4993f1609ac4bef60a 2023-10-06 15:59:57,705 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231006a4578e60ae6842e89a30a9551d54aec8 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231006a4578e60ae6842e89a30a9551d54aec8 2023-10-06 15:59:57,719 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/.tmp/cf/33133c351c944c32abf61a09089f0b40 2023-10-06 15:59:57,723 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/.tmp/cf/d6bdc0ae387e4f8fb9f434ff60aefb4f 2023-10-06 15:59:57,726 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/.tmp/cf/33133c351c944c32abf61a09089f0b40 as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/cf/33133c351c944c32abf61a09089f0b40 2023-10-06 15:59:57,728 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/.tmp/cf/d6bdc0ae387e4f8fb9f434ff60aefb4f as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/cf/d6bdc0ae387e4f8fb9f434ff60aefb4f 2023-10-06 15:59:57,729 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:57,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 15:59:57,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-06 15:59:57,731 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 15:59:57,731 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/cf/33133c351c944c32abf61a09089f0b40, entries=5, sequenceid=6, filesize=5.7 K 2023-10-06 15:59:57,733 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 42d00c9337cdd43328f22e16467edcde in 60ms, sequenceid=6, compaction requested=false 2023-10-06 15:59:57,733 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-06 15:59:57,734 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42d00c9337cdd43328f22e16467edcde: 2023-10-06 15:59:57,734 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-06 15:59:57,734 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:57,734 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/cf/33133c351c944c32abf61a09089f0b40] hfiles 2023-10-06 15:59:57,734 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/cf/33133c351c944c32abf61a09089f0b40 for snapshot=snaptb0-testConsecutiveExports 2023-10-06 15:59:57,735 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/cf/d6bdc0ae387e4f8fb9f434ff60aefb4f, entries=45, sequenceid=6, filesize=12.4 K 2023-10-06 15:59:57,735 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 5d2663940cd144e4274883f8a13a7952 in 61ms, sequenceid=6, compaction requested=false 2023-10-06 15:59:57,737 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5d2663940cd144e4274883f8a13a7952: 2023-10-06 15:59:57,737 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-06 15:59:57,737 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 15:59:57,737 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/cf/d6bdc0ae387e4f8fb9f434ff60aefb4f] hfiles 2023-10-06 15:59:57,737 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/cf/d6bdc0ae387e4f8fb9f434ff60aefb4f for snapshot=snaptb0-testConsecutiveExports 2023-10-06 15:59:57,746 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. completed. 2023-10-06 15:59:57,746 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 15:59:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-06 15:59:57,746 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 15:59:57,747 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. completed. 2023-10-06 15:59:57,747 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 15:59:57,747 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 15:59:57,747 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 15:59:57,747 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,747 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-06 15:59:57,747 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 15:59:57,748 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 15:59:57,748 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,748 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:57,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:57,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:57,748 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-06 15:59:57,750 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:57,750 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-06 15:59:57,750 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:57,750 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-06 15:59:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 15:59:57,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 15:59:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,32989,1696607957469': 2023-10-06 15:59:57,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-06 15:59:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 15:59:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 15:59:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41607,1696607957421': 2023-10-06 15:59:57,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-06 15:59:57,758 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-06 15:59:57,758 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 15:59:57,758 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 15:59:57,758 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-06 15:59:57,758 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 15:59:57,761 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,761 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,761 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 15:59:57,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 15:59:57,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,761 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,761 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,761 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 15:59:57,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,762 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,762 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 15:59:57,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,763 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 15:59:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,765 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 15:59:57,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 15:59:57,767 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-06 15:59:57,767 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,768 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,774 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 15:59:57,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 15:59:57,774 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-06 15:59:57,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 15:59:57,774 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,776 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 15:59:57,775 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-06 15:59:57,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-06 15:59:57,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 15:59:57,775 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 15:59:57,776 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 15:59:57,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 15:59:57,777 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,777 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 15:59:57,777 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,777 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 15:59:57,777 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 15:59:57,777 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,777 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231006a4578e60ae6842e89a30a9551d54aec8, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231006677a0f46fdc84b4993f1609ac4bef60a] mob files 2023-10-06 15:59:57,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231006a4578e60ae6842e89a30a9551d54aec8 2023-10-06 15:59:57,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231006677a0f46fdc84b4993f1609ac4bef60a 2023-10-06 15:59:57,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-06 15:59:57,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-06 15:59:57,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,810 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696607997628Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696607997785 (+157 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696607997785Loading Region manifests for snaptb0-testConsecutiveExports at 1696607997785Writing data manifest for snaptb0-testConsecutiveExports at 1696607997790 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696607997801 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696607997810 (+9 ms) 2023-10-06 15:59:57,812 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-06 15:59:57,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 183 msec 2023-10-06 15:59:57,931 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 15:59:57,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-06 15:59:57,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 15:59:57,933 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932 2023-10-06 15:59:57,933 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932, srcFsUri=hdfs://localhost:34141, srcDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 15:59:57,955 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 15:59:57,955 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@54ee5f5b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,955 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca, snapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-06 15:59:57,964 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 15:59:57,977 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:57,977 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:57,977 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:57,978 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:57,978 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:57,978 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:57,978 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:58,048 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/hadoop-6320719866762895322.jar 2023-10-06 15:59:58,049 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:58,049 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:58,050 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:58,050 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:58,050 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:58,051 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 15:59:58,051 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.5/hbase-shaded-miscellaneous-4.1.5.jar 2023-10-06 15:59:58,051 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.5/hbase-shaded-gson-4.1.5.jar 2023-10-06 15:59:58,052 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.5/hbase-shaded-protobuf-4.1.5.jar 2023-10-06 15:59:58,052 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.5/hbase-shaded-netty-4.1.5.jar 2023-10-06 15:59:58,052 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.5/hbase-unsafe-4.1.5.jar 2023-10-06 15:59:58,053 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 15:59:58,053 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 15:59:58,054 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 15:59:58,054 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 15:59:58,054 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 15:59:58,055 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:58,055 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:58,055 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 15:59:58,056 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:58,056 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 15:59:58,056 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 15:59:58,057 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 15:59:58,468 WARN [Listener at jenkins-hbase4.apache.org/39073] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 15:59:58,470 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-06 15:59:58,472 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-06 16:00:00,239 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 16:00:00,239 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 16:00:00,247 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0002_000001 (auth:SIMPLE) 2023-10-06 16:00:00,555 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0003_000001 (auth:SIMPLE) 2023-10-06 16:00:01,371 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 16:00:04,632 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0003_000001 (auth:SIMPLE) 2023-10-06 16:00:06,892 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0003_000001 (auth:SIMPLE) 2023-10-06 16:00:10,103 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0003_000001 (auth:SIMPLE) 2023-10-06 16:00:11,644 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 16:00:11,645 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 16:00:11,649 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-06 16:00:11,649 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 16:00:11,650 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 16:00:11,650 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 16:00:11,652 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 16:00:11,652 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 16:00:11,653 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@37d16df1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 16:00:11,653 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 16:00:11,653 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 16:00:11,655 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932, srcFsUri=hdfs://localhost:34141, srcDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 16:00:11,688 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 16:00:11,688 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4aa16af5, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 16:00:11,688 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca, snapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-06 16:00:11,701 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-06 16:00:11,712 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,713 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,713 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,713 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,714 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,714 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,714 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,782 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/hadoop-5959007507265477858.jar 2023-10-06 16:00:11,782 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,783 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,783 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,783 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,784 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,784 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:11,784 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.5/hbase-shaded-miscellaneous-4.1.5.jar 2023-10-06 16:00:11,785 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.5/hbase-shaded-gson-4.1.5.jar 2023-10-06 16:00:11,785 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.5/hbase-shaded-protobuf-4.1.5.jar 2023-10-06 16:00:11,786 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.5/hbase-shaded-netty-4.1.5.jar 2023-10-06 16:00:11,786 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.5/hbase-unsafe-4.1.5.jar 2023-10-06 16:00:11,787 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 16:00:11,787 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 16:00:11,788 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 16:00:11,788 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 16:00:11,789 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 16:00:11,790 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:11,790 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:11,790 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:11,791 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:11,791 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:11,791 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:11,792 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:12,167 WARN [Listener at jenkins-hbase4.apache.org/39073] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 16:00:12,169 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-06 16:00:12,171 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-06 16:00:16,287 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 16:00:16,287 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 16:00:16,289 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0003_000001 (auth:SIMPLE) 2023-10-06 16:00:17,082 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0004_000001 (auth:SIMPLE) 2023-10-06 16:00:20,727 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0004_000001 (auth:SIMPLE) 2023-10-06 16:00:22,924 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0004_000001 (auth:SIMPLE) 2023-10-06 16:00:25,123 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0004_000001 (auth:SIMPLE) 2023-10-06 16:00:26,327 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 16:00:26,328 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 16:00:26,331 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-06 16:00:26,331 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 16:00:26,331 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 16:00:26,332 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 16:00:26,335 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 16:00:26,335 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 16:00:26,335 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@37d16df1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-06 16:00:26,335 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-06 16:00:26,335 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/local-export-1696607997932/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-06 16:00:26,347 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-06 16:00:26,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-06 16:00:26,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-06 16:00:26,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-06 16:00:26,351 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608026351"}]},"ts":"1696608026351"} 2023-10-06 16:00:26,353 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-06 16:00:26,354 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-06 16:00:26,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42d00c9337cdd43328f22e16467edcde, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d2663940cd144e4274883f8a13a7952, UNASSIGN}] 2023-10-06 16:00:26,356 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42d00c9337cdd43328f22e16467edcde, UNASSIGN 2023-10-06 16:00:26,357 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d2663940cd144e4274883f8a13a7952, UNASSIGN 2023-10-06 16:00:26,357 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=42d00c9337cdd43328f22e16467edcde, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:26,357 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5d2663940cd144e4274883f8a13a7952, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:26,357 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696608026357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608026357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608026357"}]},"ts":"1696608026357"} 2023-10-06 16:00:26,357 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696608026357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608026357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608026357"}]},"ts":"1696608026357"} 2023-10-06 16:00:26,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 42d00c9337cdd43328f22e16467edcde, server=jenkins-hbase4.apache.org,32989,1696607957469}] 2023-10-06 16:00:26,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 5d2663940cd144e4274883f8a13a7952, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 16:00:26,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-06 16:00:26,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 42d00c9337cdd43328f22e16467edcde 2023-10-06 16:00:26,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 42d00c9337cdd43328f22e16467edcde, disabling compactions & flushes 2023-10-06 16:00:26,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 16:00:26,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 16:00:26,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. after waiting 0 ms 2023-10-06 16:00:26,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 16:00:26,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5d2663940cd144e4274883f8a13a7952 2023-10-06 16:00:26,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5d2663940cd144e4274883f8a13a7952, disabling compactions & flushes 2023-10-06 16:00:26,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 16:00:26,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 16:00:26,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. after waiting 0 ms 2023-10-06 16:00:26,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 16:00:26,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 16:00:26,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:00:26,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 16:00:26,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde. 2023-10-06 16:00:26,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 42d00c9337cdd43328f22e16467edcde: 2023-10-06 16:00:26,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:00:26,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952. 2023-10-06 16:00:26,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5d2663940cd144e4274883f8a13a7952: 2023-10-06 16:00:26,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 42d00c9337cdd43328f22e16467edcde 2023-10-06 16:00:26,529 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=42d00c9337cdd43328f22e16467edcde, regionState=CLOSED 2023-10-06 16:00:26,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5d2663940cd144e4274883f8a13a7952 2023-10-06 16:00:26,529 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696608026529"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608026529"}]},"ts":"1696608026529"} 2023-10-06 16:00:26,530 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5d2663940cd144e4274883f8a13a7952, regionState=CLOSED 2023-10-06 16:00:26,530 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696608026530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608026530"}]},"ts":"1696608026530"} 2023-10-06 16:00:26,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-06 16:00:26,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 42d00c9337cdd43328f22e16467edcde, server=jenkins-hbase4.apache.org,32989,1696607957469 in 172 msec 2023-10-06 16:00:26,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-06 16:00:26,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 5d2663940cd144e4274883f8a13a7952, server=jenkins-hbase4.apache.org,41607,1696607957421 in 173 msec 2023-10-06 16:00:26,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42d00c9337cdd43328f22e16467edcde, UNASSIGN in 178 msec 2023-10-06 16:00:26,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-06 16:00:26,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5d2663940cd144e4274883f8a13a7952, UNASSIGN in 179 msec 2023-10-06 16:00:26,536 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608026536"}]},"ts":"1696608026536"} 2023-10-06 16:00:26,537 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-06 16:00:26,540 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-06 16:00:26,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 193 msec 2023-10-06 16:00:26,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-06 16:00:26,653 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-06 16:00:26,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-06 16:00:26,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 16:00:26,657 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 16:00:26,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-06 16:00:26,657 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 16:00:26,660 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-06 16:00:26,662 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 16:00:26,663 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 16:00:26,663 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 16:00:26,663 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 16:00:26,663 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde 2023-10-06 16:00:26,663 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-06 16:00:26,663 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-06 16:00:26,663 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-06 16:00:26,663 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-06 16:00:26,663 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952 2023-10-06 16:00:26,664 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 16:00:26,664 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 16:00:26,665 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 16:00:26,665 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:26,664 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-06 16:00:26,665 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:26,665 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:26,664 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:26,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-06 16:00:26,665 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/recovered.edits] 2023-10-06 16:00:26,666 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/recovered.edits] 2023-10-06 16:00:26,670 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/cf/33133c351c944c32abf61a09089f0b40 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/cf/33133c351c944c32abf61a09089f0b40 2023-10-06 16:00:26,670 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/cf/d6bdc0ae387e4f8fb9f434ff60aefb4f to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/cf/d6bdc0ae387e4f8fb9f434ff60aefb4f 2023-10-06 16:00:26,673 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde/recovered.edits/9.seqid 2023-10-06 16:00:26,673 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952/recovered.edits/9.seqid 2023-10-06 16:00:26,674 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/42d00c9337cdd43328f22e16467edcde 2023-10-06 16:00:26,674 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testConsecutiveExports/5d2663940cd144e4274883f8a13a7952 2023-10-06 16:00:26,674 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-06 16:00:26,674 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-06 16:00:26,675 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-06 16:00:26,678 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231006a4578e60ae6842e89a30a9551d54aec8 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20231006a4578e60ae6842e89a30a9551d54aec8 2023-10-06 16:00:26,680 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231006677a0f46fdc84b4993f1609ac4bef60a to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231006677a0f46fdc84b4993f1609ac4bef60a 2023-10-06 16:00:26,680 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-06 16:00:26,683 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 16:00:26,685 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-06 16:00:26,687 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-06 16:00:26,688 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 16:00:26,688 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-06 16:00:26,688 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696608026688"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:26,689 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696608026688"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:26,690 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 16:00:26,690 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 42d00c9337cdd43328f22e16467edcde, NAME => 'testtb-testConsecutiveExports,,1696607996104.42d00c9337cdd43328f22e16467edcde.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5d2663940cd144e4274883f8a13a7952, NAME => 'testtb-testConsecutiveExports,1,1696607996104.5d2663940cd144e4274883f8a13a7952.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 16:00:26,690 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-06 16:00:26,690 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696608026690"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:26,692 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-06 16:00:26,695 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-06 16:00:26,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 41 msec 2023-10-06 16:00:26,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-06 16:00:26,767 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-06 16:00:26,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-06 16:00:26,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-06 16:00:26,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-06 16:00:26,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-06 16:00:26,802 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 762), OpenFileDescriptor=896 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=262 (was 285), ProcessCount=166 (was 166), AvailableMemoryMB=2290 (was 2483) 2023-10-06 16:00:26,802 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-10-06 16:00:26,820 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=262, ProcessCount=166, AvailableMemoryMB=2289 2023-10-06 16:00:26,820 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-10-06 16:00:26,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 16:00:26,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:26,824 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 16:00:26,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-06 16:00:26,825 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 16:00:26,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 16:00:26,827 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:26,827 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:26,828 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c empty. 2023-10-06 16:00:26,828 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893 empty. 2023-10-06 16:00:26,828 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:26,828 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:26,828 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-06 16:00:26,838 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-06 16:00:26,839 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8a39adac605576ebdfc0db8adf758a3c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 16:00:26,840 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => e7a5c3a99e05dbbf25ba0f5e13fcd893, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 16:00:26,852 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:26,852 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing e7a5c3a99e05dbbf25ba0f5e13fcd893, disabling compactions & flushes 2023-10-06 16:00:26,852 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:26,852 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:26,852 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. after waiting 0 ms 2023-10-06 16:00:26,852 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:26,852 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:26,852 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for e7a5c3a99e05dbbf25ba0f5e13fcd893: 2023-10-06 16:00:26,853 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:26,853 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 8a39adac605576ebdfc0db8adf758a3c, disabling compactions & flushes 2023-10-06 16:00:26,853 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:26,854 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:26,854 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. after waiting 0 ms 2023-10-06 16:00:26,854 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:26,854 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:26,854 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 8a39adac605576ebdfc0db8adf758a3c: 2023-10-06 16:00:26,856 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 16:00:26,857 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696608026857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608026857"}]},"ts":"1696608026857"} 2023-10-06 16:00:26,857 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696608026857"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608026857"}]},"ts":"1696608026857"} 2023-10-06 16:00:26,862 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 16:00:26,863 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 16:00:26,863 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608026863"}]},"ts":"1696608026863"} 2023-10-06 16:00:26,864 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-06 16:00:26,867 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 16:00:26,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 16:00:26,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 16:00:26,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 16:00:26,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 16:00:26,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8a39adac605576ebdfc0db8adf758a3c, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e7a5c3a99e05dbbf25ba0f5e13fcd893, ASSIGN}] 2023-10-06 16:00:26,870 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e7a5c3a99e05dbbf25ba0f5e13fcd893, ASSIGN 2023-10-06 16:00:26,870 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8a39adac605576ebdfc0db8adf758a3c, ASSIGN 2023-10-06 16:00:26,871 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e7a5c3a99e05dbbf25ba0f5e13fcd893, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41607,1696607957421; forceNewPlan=false, retain=false 2023-10-06 16:00:26,871 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8a39adac605576ebdfc0db8adf758a3c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32989,1696607957469; forceNewPlan=false, retain=false 2023-10-06 16:00:26,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 16:00:27,021 INFO [jenkins-hbase4:45793] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 16:00:27,024 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=8a39adac605576ebdfc0db8adf758a3c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,024 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=e7a5c3a99e05dbbf25ba0f5e13fcd893, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,024 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696608027024"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608027024"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608027024"}]},"ts":"1696608027024"} 2023-10-06 16:00:27,024 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696608027024"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608027024"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608027024"}]},"ts":"1696608027024"} 2023-10-06 16:00:27,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure e7a5c3a99e05dbbf25ba0f5e13fcd893, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 16:00:27,026 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 8a39adac605576ebdfc0db8adf758a3c, server=jenkins-hbase4.apache.org,32989,1696607957469}] 2023-10-06 16:00:27,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 16:00:27,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:27,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e7a5c3a99e05dbbf25ba0f5e13fcd893, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 16:00:27,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a39adac605576ebdfc0db8adf758a3c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 16:00:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. service=AccessControlService 2023-10-06 16:00:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. service=AccessControlService 2023-10-06 16:00:27,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 16:00:27,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 16:00:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:27,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:27,185 INFO [StoreOpener-e7a5c3a99e05dbbf25ba0f5e13fcd893-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:27,185 INFO [StoreOpener-8a39adac605576ebdfc0db8adf758a3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:27,189 DEBUG [StoreOpener-e7a5c3a99e05dbbf25ba0f5e13fcd893-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/cf 2023-10-06 16:00:27,189 DEBUG [StoreOpener-e7a5c3a99e05dbbf25ba0f5e13fcd893-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/cf 2023-10-06 16:00:27,189 DEBUG [StoreOpener-8a39adac605576ebdfc0db8adf758a3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/cf 2023-10-06 16:00:27,189 DEBUG [StoreOpener-8a39adac605576ebdfc0db8adf758a3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/cf 2023-10-06 16:00:27,190 INFO [StoreOpener-e7a5c3a99e05dbbf25ba0f5e13fcd893-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7a5c3a99e05dbbf25ba0f5e13fcd893 columnFamilyName cf 2023-10-06 16:00:27,190 INFO [StoreOpener-8a39adac605576ebdfc0db8adf758a3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a39adac605576ebdfc0db8adf758a3c columnFamilyName cf 2023-10-06 16:00:27,191 INFO [StoreOpener-8a39adac605576ebdfc0db8adf758a3c-1] regionserver.HStore(310): Store=8a39adac605576ebdfc0db8adf758a3c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 16:00:27,192 INFO [StoreOpener-e7a5c3a99e05dbbf25ba0f5e13fcd893-1] regionserver.HStore(310): Store=e7a5c3a99e05dbbf25ba0f5e13fcd893/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 16:00:27,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:27,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:27,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:27,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:27,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:27,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:27,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 16:00:27,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 16:00:27,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8a39adac605576ebdfc0db8adf758a3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65010368, jitterRate=-0.03127002716064453}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 16:00:27,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e7a5c3a99e05dbbf25ba0f5e13fcd893; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70234080, jitterRate=0.0465693473815918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 16:00:27,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8a39adac605576ebdfc0db8adf758a3c: 2023-10-06 16:00:27,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e7a5c3a99e05dbbf25ba0f5e13fcd893: 2023-10-06 16:00:27,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c., pid=61, masterSystemTime=1696608027178 2023-10-06 16:00:27,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893., pid=60, masterSystemTime=1696608027177 2023-10-06 16:00:27,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:27,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:27,202 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=8a39adac605576ebdfc0db8adf758a3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:27,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:27,202 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696608027202"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696608027202"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696608027202"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696608027202"}]},"ts":"1696608027202"} 2023-10-06 16:00:27,202 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=e7a5c3a99e05dbbf25ba0f5e13fcd893, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,203 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696608027202"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696608027202"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696608027202"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696608027202"}]},"ts":"1696608027202"} 2023-10-06 16:00:27,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-10-06 16:00:27,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 8a39adac605576ebdfc0db8adf758a3c, server=jenkins-hbase4.apache.org,32989,1696607957469 in 178 msec 2023-10-06 16:00:27,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-06 16:00:27,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure e7a5c3a99e05dbbf25ba0f5e13fcd893, server=jenkins-hbase4.apache.org,41607,1696607957421 in 179 msec 2023-10-06 16:00:27,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8a39adac605576ebdfc0db8adf758a3c, ASSIGN in 339 msec 2023-10-06 16:00:27,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-06 16:00:27,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e7a5c3a99e05dbbf25ba0f5e13fcd893, ASSIGN in 340 msec 2023-10-06 16:00:27,211 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 16:00:27,211 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608027211"}]},"ts":"1696608027211"} 2023-10-06 16:00:27,212 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-06 16:00:27,215 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 16:00:27,215 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-06 16:00:27,217 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-06 16:00:27,224 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:27,224 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:27,224 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:27,224 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:27,226 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:27,226 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:27,226 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:27,226 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:27,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 404 msec 2023-10-06 16:00:27,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-06 16:00:27,429 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-06 16:00:27,431 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,431 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:27,433 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 16:00:27,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 16:00:27,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696608027444 (current time:1696608027444). 2023-10-06 16:00:27,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 16:00:27,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x51529c23 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:27,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1be745cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:27,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:27,455 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:27,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51529c23 to 127.0.0.1:55741 2023-10-06 16:00:27,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:27,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x0846f092 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:27,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4db0d63d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:27,463 DEBUG [hconnection-0x6cd83b79-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:27,465 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:27,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0846f092 to 127.0.0.1:55741 2023-10-06 16:00:27,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:27,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-06 16:00:27,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 16:00:27,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 16:00:27,473 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 16:00:27,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 16:00:27,475 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 16:00:27,476 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696608627476 2023-10-06 16:00:27,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 16:00:27,477 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 16:00:27,477 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 16:00:27,478 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 16:00:27,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 16:00:27,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-06 16:00:27,479 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 16:00:27,480 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696608627480 2023-10-06 16:00:27,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,489 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-06 16:00:27,489 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:27,490 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-06 16:00:27,490 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-06 16:00:27,490 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,490 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,491 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,491 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,491 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,491 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,492 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,492 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,492 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,492 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,493 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,493 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 16:00:27,493 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 16:00:27,493 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:27,493 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:27,494 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 16:00:27,495 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 16:00:27,493 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:27,495 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 16:00:27,496 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 16:00:27,496 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 16:00:27,496 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 16:00:27,495 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 16:00:27,496 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 16:00:27,496 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 16:00:27,497 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,497 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:27,497 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,499 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,500 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:27,500 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,499 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,500 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:27,500 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:27,500 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,500 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:27,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 16:00:27,502 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c3af1fa[Count = 1] remaining members to acquire global barrier 2023-10-06 16:00:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:27,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 16:00:27,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c3af1fa[Count = 0] remaining members to acquire global barrier 2023-10-06 16:00:27,504 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-06 16:00:27,504 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,505 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,505 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,505 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,505 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 16:00:27,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,506 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 16:00:27,506 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 16:00:27,505 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,506 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:27,506 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 16:00:27,506 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. started... 2023-10-06 16:00:27,506 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:27,506 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:27,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,506 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a39adac605576ebdfc0db8adf758a3c: 2023-10-06 16:00:27,506 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,506 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 16:00:27,506 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 16:00:27,506 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,506 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:27,506 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 16:00:27,506 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:27,506 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:27,506 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:27,506 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. started... 2023-10-06 16:00:27,507 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7a5c3a99e05dbbf25ba0f5e13fcd893: 2023-10-06 16:00:27,508 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,508 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:27,508 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 16:00:27,513 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 16:00:27,513 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:27,513 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 16:00:27,518 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. completed. 2023-10-06 16:00:27,519 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:27,519 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:27,519 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:27,519 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,519 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 16:00:27,519 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 16:00:27,520 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 16:00:27,520 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,520 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:27,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:27,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:27,521 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 16:00:27,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:27,522 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. completed. 2023-10-06 16:00:27,522 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:27,522 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:27,522 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:27,522 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,522 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 16:00:27,522 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 16:00:27,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:27,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,524 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,524 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 16:00:27,524 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:27,524 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 16:00:27,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:27,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41607,1696607957421': 2023-10-06 16:00:27,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-06 16:00:27,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:27,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:27,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:27,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:27,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,32989,1696607957469': 2023-10-06 16:00:27,530 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-06 16:00:27,530 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-06 16:00:27,530 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 16:00:27,530 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 16:00:27,530 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,530 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 16:00:27,531 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,531 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:27,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,532 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,532 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,531 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:27,532 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,532 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,532 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,533 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:27,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,533 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:27,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,535 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,535 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,536 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,539 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,539 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,539 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,539 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,539 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,539 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,539 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,539 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,539 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:27,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,539 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,539 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 16:00:27,540 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,541 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,541 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,541 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,541 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,541 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,541 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,541 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 16:00:27,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,577 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:27,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 16:00:27,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-06 16:00:27,578 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 16:00:27,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,582 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-06 16:00:27,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,582 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696608027476Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696608027553 (+77 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696608027553Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696608027553Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696608027564 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696608027576 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696608027582 (+6 ms) 2023-10-06 16:00:27,585 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 16:00:27,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 109 msec 2023-10-06 16:00:27,779 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:27,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 16:00:27,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 16:00:27,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32989] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 16:00:27,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41607] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 16:00:27,786 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,786 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:27,787 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 16:00:27,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 16:00:27,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696608027797 (current time:1696608027797). 2023-10-06 16:00:27,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 16:00:27,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x287a328c to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:27,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58417f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:27,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:27,806 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:27,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x287a328c to 127.0.0.1:55741 2023-10-06 16:00:27,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:27,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x692b100a to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:27,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10bca1f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:27,815 DEBUG [hconnection-0x35223fb7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:27,817 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:27,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x692b100a to 127.0.0.1:55741 2023-10-06 16:00:27,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:27,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-06 16:00:27,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 16:00:27,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 16:00:27,823 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 16:00:27,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 16:00:27,825 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 16:00:27,826 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696608627826 2023-10-06 16:00:27,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-06 16:00:27,826 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,827 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 16:00:27,827 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 16:00:27,828 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-06 16:00:27,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 16:00:27,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-10-06 16:00:27,830 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 16:00:27,830 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696608627830 2023-10-06 16:00:27,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,838 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-06 16:00:27,838 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:27,839 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-06 16:00:27,839 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-06 16:00:27,839 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,839 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,840 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,840 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,840 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,840 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,841 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,841 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,841 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,841 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 16:00:27,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-06 16:00:27,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,842 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 16:00:27,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-06 16:00:27,842 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 16:00:27,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-06 16:00:27,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,842 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 16:00:27,842 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-06 16:00:27,842 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:27,843 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 16:00:27,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,843 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 16:00:27,843 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-06 16:00:27,843 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:27,843 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 16:00:27,844 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 16:00:27,843 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:27,844 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 16:00:27,845 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-06 16:00:27,845 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 16:00:27,845 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-06 16:00:27,845 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 16:00:27,844 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-06 16:00:27,846 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,846 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,846 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:27,846 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,847 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:27,847 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,847 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:27,847 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,847 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:27,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:27,847 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,848 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:27,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:27,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 16:00:27,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bb5b766[Count = 1] remaining members to acquire global barrier 2023-10-06 16:00:27,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:27,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:27,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:27,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-06 16:00:27,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bb5b766[Count = 0] remaining members to acquire global barrier 2023-10-06 16:00:27,851 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-06 16:00:27,851 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,853 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,853 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,853 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,853 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 16:00:27,853 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,853 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 16:00:27,853 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:27,853 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:27,853 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 16:00:27,854 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. started... 2023-10-06 16:00:27,854 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 16:00:27,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,854 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,854 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 16:00:27,854 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e7a5c3a99e05dbbf25ba0f5e13fcd893 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-06 16:00:27,853 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:27,854 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-06 16:00:27,854 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:27,854 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:27,854 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:27,854 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. started... 2023-10-06 16:00:27,854 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a39adac605576ebdfc0db8adf758a3c 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-06 16:00:27,855 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 16:00:27,855 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:27,855 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 16:00:27,871 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006a813395ff2344ffc9c4eecb0842cf5f8 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231006a813395ff2344ffc9c4eecb0842cf5f8 2023-10-06 16:00:27,871 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310067d68fec3d95f4afdb16fb4733dca5ba7 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310067d68fec3d95f4afdb16fb4733dca5ba7 2023-10-06 16:00:27,885 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/.tmp/cf/e240bbf4bddb4d1bbf27362875bea0b4 2023-10-06 16:00:27,886 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/.tmp/cf/65b15ce9571d4be9a2195e6c2a492a3f 2023-10-06 16:00:27,891 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/.tmp/cf/e240bbf4bddb4d1bbf27362875bea0b4 as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/cf/e240bbf4bddb4d1bbf27362875bea0b4 2023-10-06 16:00:27,891 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/.tmp/cf/65b15ce9571d4be9a2195e6c2a492a3f as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/cf/65b15ce9571d4be9a2195e6c2a492a3f 2023-10-06 16:00:27,896 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/cf/e240bbf4bddb4d1bbf27362875bea0b4, entries=46, sequenceid=6, filesize=13.3 K 2023-10-06 16:00:27,896 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/cf/65b15ce9571d4be9a2195e6c2a492a3f, entries=4, sequenceid=6, filesize=5.6 K 2023-10-06 16:00:27,897 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for e7a5c3a99e05dbbf25ba0f5e13fcd893 in 43ms, sequenceid=6, compaction requested=false 2023-10-06 16:00:27,897 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 8a39adac605576ebdfc0db8adf758a3c in 43ms, sequenceid=6, compaction requested=false 2023-10-06 16:00:27,897 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-06 16:00:27,897 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-06 16:00:27,900 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7a5c3a99e05dbbf25ba0f5e13fcd893: 2023-10-06 16:00:27,900 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a39adac605576ebdfc0db8adf758a3c: 2023-10-06 16:00:27,900 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,900 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,900 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:27,900 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:27,900 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/cf/e240bbf4bddb4d1bbf27362875bea0b4] hfiles 2023-10-06 16:00:27,900 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/cf/65b15ce9571d4be9a2195e6c2a492a3f] hfiles 2023-10-06 16:00:27,900 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/cf/e240bbf4bddb4d1bbf27362875bea0b4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,900 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/cf/65b15ce9571d4be9a2195e6c2a492a3f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,912 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. completed. 2023-10-06 16:00:27,912 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:27,912 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:27,913 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:27,913 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,913 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. completed. 2023-10-06 16:00:27,913 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 16:00:27,913 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:27,913 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 16:00:27,913 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:27,913 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:27,913 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,913 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-06 16:00:27,913 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 16:00:27,915 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,915 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 16:00:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,915 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-06 16:00:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:27,915 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:27,915 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,915 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 16:00:27,915 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:27,916 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-06 16:00:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41607,1696607957421': 2023-10-06 16:00:27,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-06 16:00:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,32989,1696607957469': 2023-10-06 16:00:27,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-06 16:00:27,924 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-06 16:00:27,924 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 16:00:27,924 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 16:00:27,924 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,924 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 16:00:27,927 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:27,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 16:00:27,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-06 16:00:27,929 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 16:00:27,929 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,929 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,929 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,929 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,929 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,929 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,930 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:27,930 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,930 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:27,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,931 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:27,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,933 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,933 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:27,933 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,936 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,936 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,936 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,936 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,936 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:27,936 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,936 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,936 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,936 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:27,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:27,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,936 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,936 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,936 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:27,938 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:27,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 16:00:27,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,938 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:27,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:27,938 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:27,939 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,939 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:27,939 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:27,939 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,939 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310067d68fec3d95f4afdb16fb4733dca5ba7, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231006a813395ff2344ffc9c4eecb0842cf5f8] mob files 2023-10-06 16:00:27,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310067d68fec3d95f4afdb16fb4733dca5ba7 2023-10-06 16:00:27,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231006a813395ff2344ffc9c4eecb0842cf5f8 2023-10-06 16:00:27,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-06 16:00:27,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,966 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:27,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696608027826Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696608027946 (+120 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696608027946Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696608027946Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696608027950 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696608027957 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696608027965 (+8 ms) 2023-10-06 16:00:27,969 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-06 16:00:27,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 142 msec 2023-10-06 16:00:28,129 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:28,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-06 16:00:28,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 16:00:28,157 DEBUG [Listener at jenkins-hbase4.apache.org/39073] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 16:00:28,161 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 16:00:28,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32989] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-06 16:00:28,163 DEBUG [Listener at jenkins-hbase4.apache.org/39073] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 16:00:28,167 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 16:00:28,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36069] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-06 16:00:28,168 DEBUG [Listener at jenkins-hbase4.apache.org/39073] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 16:00:28,172 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 16:00:28,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41607] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-06 16:00:28,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-06 16:00:28,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:28,177 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 16:00:28,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-06 16:00:28,177 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 16:00:28,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 16:00:28,180 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:28,180 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:28,180 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0 empty. 2023-10-06 16:00:28,180 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82 empty. 2023-10-06 16:00:28,181 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:28,181 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:28,181 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-06 16:00:28,194 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-06 16:00:28,195 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => ca026a72e7becbbf6666a8d0dda33fc0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 16:00:28,195 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0c862a7112bdc49982a1783d7c5a2a82, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 16:00:28,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:28,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:28,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing ca026a72e7becbbf6666a8d0dda33fc0, disabling compactions & flushes 2023-10-06 16:00:28,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 0c862a7112bdc49982a1783d7c5a2a82, disabling compactions & flushes 2023-10-06 16:00:28,203 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. 2023-10-06 16:00:28,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. 2023-10-06 16:00:28,203 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. 2023-10-06 16:00:28,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. 2023-10-06 16:00:28,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. after waiting 0 ms 2023-10-06 16:00:28,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. 2023-10-06 16:00:28,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. after waiting 0 ms 2023-10-06 16:00:28,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. 2023-10-06 16:00:28,203 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. 2023-10-06 16:00:28,203 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. 2023-10-06 16:00:28,203 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for ca026a72e7becbbf6666a8d0dda33fc0: 2023-10-06 16:00:28,204 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 0c862a7112bdc49982a1783d7c5a2a82: 2023-10-06 16:00:28,205 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 16:00:28,206 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696608028206"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608028206"}]},"ts":"1696608028206"} 2023-10-06 16:00:28,206 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696608028206"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608028206"}]},"ts":"1696608028206"} 2023-10-06 16:00:28,208 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 16:00:28,209 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 16:00:28,209 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608028209"}]},"ts":"1696608028209"} 2023-10-06 16:00:28,210 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-06 16:00:28,213 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 16:00:28,214 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 16:00:28,214 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 16:00:28,214 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 16:00:28,214 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 16:00:28,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ca026a72e7becbbf6666a8d0dda33fc0, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c862a7112bdc49982a1783d7c5a2a82, ASSIGN}] 2023-10-06 16:00:28,217 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c862a7112bdc49982a1783d7c5a2a82, ASSIGN 2023-10-06 16:00:28,217 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ca026a72e7becbbf6666a8d0dda33fc0, ASSIGN 2023-10-06 16:00:28,218 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ca026a72e7becbbf6666a8d0dda33fc0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36069,1696607957508; forceNewPlan=false, retain=false 2023-10-06 16:00:28,218 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c862a7112bdc49982a1783d7c5a2a82, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41607,1696607957421; forceNewPlan=false, retain=false 2023-10-06 16:00:28,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 16:00:28,368 INFO [jenkins-hbase4:45793] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 16:00:28,370 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0c862a7112bdc49982a1783d7c5a2a82, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:28,371 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ca026a72e7becbbf6666a8d0dda33fc0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:28,371 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696608028370"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608028370"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608028370"}]},"ts":"1696608028370"} 2023-10-06 16:00:28,371 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696608028370"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608028370"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608028370"}]},"ts":"1696608028370"} 2023-10-06 16:00:28,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 0c862a7112bdc49982a1783d7c5a2a82, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 16:00:28,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure ca026a72e7becbbf6666a8d0dda33fc0, server=jenkins-hbase4.apache.org,36069,1696607957508}] 2023-10-06 16:00:28,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 16:00:28,525 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:28,526 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-06 16:00:28,529 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-06 16:00:28,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. 2023-10-06 16:00:28,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c862a7112bdc49982a1783d7c5a2a82, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82.', STARTKEY => '2', ENDKEY => ''} 2023-10-06 16:00:28,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. service=AccessControlService 2023-10-06 16:00:28,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 16:00:28,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:28,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:28,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:28,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:28,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. 2023-10-06 16:00:28,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca026a72e7becbbf6666a8d0dda33fc0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0.', STARTKEY => '', ENDKEY => '2'} 2023-10-06 16:00:28,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. service=AccessControlService 2023-10-06 16:00:28,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 16:00:28,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:28,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:28,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:28,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:28,534 INFO [StoreOpener-0c862a7112bdc49982a1783d7c5a2a82-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:28,535 INFO [StoreOpener-ca026a72e7becbbf6666a8d0dda33fc0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:28,535 DEBUG [StoreOpener-0c862a7112bdc49982a1783d7c5a2a82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/cf 2023-10-06 16:00:28,535 DEBUG [StoreOpener-0c862a7112bdc49982a1783d7c5a2a82-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/cf 2023-10-06 16:00:28,536 INFO [StoreOpener-0c862a7112bdc49982a1783d7c5a2a82-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c862a7112bdc49982a1783d7c5a2a82 columnFamilyName cf 2023-10-06 16:00:28,536 DEBUG [StoreOpener-ca026a72e7becbbf6666a8d0dda33fc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/cf 2023-10-06 16:00:28,536 DEBUG [StoreOpener-ca026a72e7becbbf6666a8d0dda33fc0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/cf 2023-10-06 16:00:28,536 INFO [StoreOpener-0c862a7112bdc49982a1783d7c5a2a82-1] regionserver.HStore(310): Store=0c862a7112bdc49982a1783d7c5a2a82/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 16:00:28,536 INFO [StoreOpener-ca026a72e7becbbf6666a8d0dda33fc0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca026a72e7becbbf6666a8d0dda33fc0 columnFamilyName cf 2023-10-06 16:00:28,537 INFO [StoreOpener-ca026a72e7becbbf6666a8d0dda33fc0-1] regionserver.HStore(310): Store=ca026a72e7becbbf6666a8d0dda33fc0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 16:00:28,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:28,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:28,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:28,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:28,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:28,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:28,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 16:00:28,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 16:00:28,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0c862a7112bdc49982a1783d7c5a2a82; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72345720, jitterRate=0.07803523540496826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 16:00:28,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0c862a7112bdc49982a1783d7c5a2a82: 2023-10-06 16:00:28,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ca026a72e7becbbf6666a8d0dda33fc0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74258042, jitterRate=0.1065310537815094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 16:00:28,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ca026a72e7becbbf6666a8d0dda33fc0: 2023-10-06 16:00:28,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82., pid=69, masterSystemTime=1696608028525 2023-10-06 16:00:28,545 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0., pid=70, masterSystemTime=1696608028525 2023-10-06 16:00:28,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. 2023-10-06 16:00:28,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. 2023-10-06 16:00:28,547 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0c862a7112bdc49982a1783d7c5a2a82, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:28,547 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696608028547"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696608028547"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696608028547"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696608028547"}]},"ts":"1696608028547"} 2023-10-06 16:00:28,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-10-06 16:00:28,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 0c862a7112bdc49982a1783d7c5a2a82, server=jenkins-hbase4.apache.org,41607,1696607957421 in 177 msec 2023-10-06 16:00:28,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c862a7112bdc49982a1783d7c5a2a82, ASSIGN in 336 msec 2023-10-06 16:00:28,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. 2023-10-06 16:00:28,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. 2023-10-06 16:00:28,557 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ca026a72e7becbbf6666a8d0dda33fc0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:28,557 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696608028557"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696608028557"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696608028557"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696608028557"}]},"ts":"1696608028557"} 2023-10-06 16:00:28,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-10-06 16:00:28,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure ca026a72e7becbbf6666a8d0dda33fc0, server=jenkins-hbase4.apache.org,36069,1696607957508 in 185 msec 2023-10-06 16:00:28,561 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-06 16:00:28,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ca026a72e7becbbf6666a8d0dda33fc0, ASSIGN in 346 msec 2023-10-06 16:00:28,562 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 16:00:28,562 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608028562"}]},"ts":"1696608028562"} 2023-10-06 16:00:28,563 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-06 16:00:28,569 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 16:00:28,570 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-06 16:00:28,571 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-06 16:00:28,573 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:28,573 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:28,573 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:28,573 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:28,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:28,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:28,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:28,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:28,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:28,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:28,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:28,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:28,576 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 400 msec 2023-10-06 16:00:28,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-06 16:00:28,781 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-06 16:00:28,784 DEBUG [Listener at jenkins-hbase4.apache.org/39073] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:28,789 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:28,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions ca026a72e7becbbf6666a8d0dda33fc0, 0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:28,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ca026a72e7becbbf6666a8d0dda33fc0, 0c862a7112bdc49982a1783d7c5a2a82], force=true 2023-10-06 16:00:28,818 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ca026a72e7becbbf6666a8d0dda33fc0, 0c862a7112bdc49982a1783d7c5a2a82], force=true 2023-10-06 16:00:28,819 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ca026a72e7becbbf6666a8d0dda33fc0, 0c862a7112bdc49982a1783d7c5a2a82], force=true 2023-10-06 16:00:28,819 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ca026a72e7becbbf6666a8d0dda33fc0, 0c862a7112bdc49982a1783d7c5a2a82], force=true 2023-10-06 16:00:28,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 16:00:28,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ca026a72e7becbbf6666a8d0dda33fc0, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c862a7112bdc49982a1783d7c5a2a82, UNASSIGN}] 2023-10-06 16:00:28,841 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c862a7112bdc49982a1783d7c5a2a82, UNASSIGN 2023-10-06 16:00:28,841 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ca026a72e7becbbf6666a8d0dda33fc0, UNASSIGN 2023-10-06 16:00:28,842 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0c862a7112bdc49982a1783d7c5a2a82, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:28,842 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ca026a72e7becbbf6666a8d0dda33fc0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:28,842 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696608028842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608028842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608028842"}]},"ts":"1696608028842"} 2023-10-06 16:00:28,842 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696608028842"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608028842"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608028842"}]},"ts":"1696608028842"} 2023-10-06 16:00:28,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 0c862a7112bdc49982a1783d7c5a2a82, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 16:00:28,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure ca026a72e7becbbf6666a8d0dda33fc0, server=jenkins-hbase4.apache.org,36069,1696607957508}] 2023-10-06 16:00:28,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 16:00:28,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:28,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0c862a7112bdc49982a1783d7c5a2a82, disabling compactions & flushes 2023-10-06 16:00:28,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:28,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. 2023-10-06 16:00:28,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. 2023-10-06 16:00:28,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. after waiting 0 ms 2023-10-06 16:00:28,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ca026a72e7becbbf6666a8d0dda33fc0, disabling compactions & flushes 2023-10-06 16:00:28,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. 2023-10-06 16:00:28,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. 2023-10-06 16:00:28,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. 2023-10-06 16:00:28,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0c862a7112bdc49982a1783d7c5a2a82 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-06 16:00:28,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. after waiting 0 ms 2023-10-06 16:00:28,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. 2023-10-06 16:00:28,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ca026a72e7becbbf6666a8d0dda33fc0 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-06 16:00:29,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/.tmp/cf/6a6e28793ea94d18b5b198177453dbcc 2023-10-06 16:00:29,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/.tmp/cf/7bb41784c6e04c94bc68b85a49d7060a 2023-10-06 16:00:29,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/.tmp/cf/6a6e28793ea94d18b5b198177453dbcc as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/cf/6a6e28793ea94d18b5b198177453dbcc 2023-10-06 16:00:29,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/.tmp/cf/7bb41784c6e04c94bc68b85a49d7060a as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/cf/7bb41784c6e04c94bc68b85a49d7060a 2023-10-06 16:00:29,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/cf/6a6e28793ea94d18b5b198177453dbcc, entries=1, sequenceid=5, filesize=4.7 K 2023-10-06 16:00:29,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 0c862a7112bdc49982a1783d7c5a2a82 in 21ms, sequenceid=5, compaction requested=false 2023-10-06 16:00:29,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-06 16:00:29,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/cf/7bb41784c6e04c94bc68b85a49d7060a, entries=1, sequenceid=5, filesize=4.7 K 2023-10-06 16:00:29,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ca026a72e7becbbf6666a8d0dda33fc0 in 27ms, sequenceid=5, compaction requested=false 2023-10-06 16:00:29,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-06 16:00:29,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-06 16:00:29,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:00:29,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82. 2023-10-06 16:00:29,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0c862a7112bdc49982a1783d7c5a2a82: 2023-10-06 16:00:29,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:00:29,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0. 2023-10-06 16:00:29,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ca026a72e7becbbf6666a8d0dda33fc0: 2023-10-06 16:00:29,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:29,033 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0c862a7112bdc49982a1783d7c5a2a82, regionState=CLOSED 2023-10-06 16:00:29,033 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696608029033"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608029033"}]},"ts":"1696608029033"} 2023-10-06 16:00:29,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:29,033 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=ca026a72e7becbbf6666a8d0dda33fc0, regionState=CLOSED 2023-10-06 16:00:29,034 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696608029033"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608029033"}]},"ts":"1696608029033"} 2023-10-06 16:00:29,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-10-06 16:00:29,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 0c862a7112bdc49982a1783d7c5a2a82, server=jenkins-hbase4.apache.org,41607,1696607957421 in 191 msec 2023-10-06 16:00:29,036 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-10-06 16:00:29,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure ca026a72e7becbbf6666a8d0dda33fc0, server=jenkins-hbase4.apache.org,36069,1696607957508 in 191 msec 2023-10-06 16:00:29,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0c862a7112bdc49982a1783d7c5a2a82, UNASSIGN in 197 msec 2023-10-06 16:00:29,038 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-06 16:00:29,038 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ca026a72e7becbbf6666a8d0dda33fc0, UNASSIGN in 200 msec 2023-10-06 16:00:29,079 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-06 16:00:29,080 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028174.ca026a72e7becbbf6666a8d0dda33fc0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:29,080 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696608028174.0c862a7112bdc49982a1783d7c5a2a82.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:29,081 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:29,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 16:00:29,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69466059fc249f2470c4df953ed361f0, ASSIGN}] 2023-10-06 16:00:29,128 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69466059fc249f2470c4df953ed361f0, ASSIGN 2023-10-06 16:00:29,129 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69466059fc249f2470c4df953ed361f0, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,36069,1696607957508; forceNewPlan=false, retain=false 2023-10-06 16:00:29,279 INFO [jenkins-hbase4:45793] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-06 16:00:29,281 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=69466059fc249f2470c4df953ed361f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:29,281 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696608029281"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608029281"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608029281"}]},"ts":"1696608029281"} 2023-10-06 16:00:29,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 69466059fc249f2470c4df953ed361f0, server=jenkins-hbase4.apache.org,36069,1696607957508}] 2023-10-06 16:00:29,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 16:00:29,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. 2023-10-06 16:00:29,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69466059fc249f2470c4df953ed361f0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0.', STARTKEY => '', ENDKEY => ''} 2023-10-06 16:00:29,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. service=AccessControlService 2023-10-06 16:00:29,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 16:00:29,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 69466059fc249f2470c4df953ed361f0 2023-10-06 16:00:29,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:29,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 69466059fc249f2470c4df953ed361f0 2023-10-06 16:00:29,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 69466059fc249f2470c4df953ed361f0 2023-10-06 16:00:29,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/.regioninfo 2023-10-06 16:00:29,448 INFO [StoreOpener-69466059fc249f2470c4df953ed361f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 69466059fc249f2470c4df953ed361f0 2023-10-06 16:00:29,448 DEBUG [StoreOpener-69466059fc249f2470c4df953ed361f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf 2023-10-06 16:00:29,448 DEBUG [StoreOpener-69466059fc249f2470c4df953ed361f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf 2023-10-06 16:00:29,449 INFO [StoreOpener-69466059fc249f2470c4df953ed361f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69466059fc249f2470c4df953ed361f0 columnFamilyName cf 2023-10-06 16:00:29,475 DEBUG [StoreOpener-69466059fc249f2470c4df953ed361f0-1] regionserver.HStore(539): loaded hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf/6a6e28793ea94d18b5b198177453dbcc.0c862a7112bdc49982a1783d7c5a2a82->hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/cf/6a6e28793ea94d18b5b198177453dbcc-top 2023-10-06 16:00:29,480 DEBUG [StoreOpener-69466059fc249f2470c4df953ed361f0-1] regionserver.HStore(539): loaded hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf/7bb41784c6e04c94bc68b85a49d7060a.ca026a72e7becbbf6666a8d0dda33fc0->hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/cf/7bb41784c6e04c94bc68b85a49d7060a-top 2023-10-06 16:00:29,481 INFO [StoreOpener-69466059fc249f2470c4df953ed361f0-1] regionserver.HStore(310): Store=69466059fc249f2470c4df953ed361f0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 16:00:29,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0 2023-10-06 16:00:29,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0 2023-10-06 16:00:29,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 69466059fc249f2470c4df953ed361f0 2023-10-06 16:00:29,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 69466059fc249f2470c4df953ed361f0; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61540447, jitterRate=-0.08297587931156158}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 16:00:29,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 69466059fc249f2470c4df953ed361f0: 2023-10-06 16:00:29,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0., pid=77, masterSystemTime=1696608029434 2023-10-06 16:00:29,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0.,because compaction is disabled. 2023-10-06 16:00:29,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. 2023-10-06 16:00:29,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. 2023-10-06 16:00:29,489 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=69466059fc249f2470c4df953ed361f0, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:29,489 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696608029489"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696608029489"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696608029489"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696608029489"}]},"ts":"1696608029489"} 2023-10-06 16:00:29,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-06 16:00:29,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 69466059fc249f2470c4df953ed361f0, server=jenkins-hbase4.apache.org,36069,1696607957508 in 208 msec 2023-10-06 16:00:29,494 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-06 16:00:29,494 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69466059fc249f2470c4df953ed361f0, ASSIGN in 365 msec 2023-10-06 16:00:29,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[ca026a72e7becbbf6666a8d0dda33fc0, 0c862a7112bdc49982a1783d7c5a2a82], force=true in 682 msec 2023-10-06 16:00:29,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-06 16:00:29,925 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-06 16:00:29,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-06 16:00:29,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696608029926 (current time:1696608029926). 2023-10-06 16:00:29,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 16:00:29,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x4be43520 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:29,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@caf9df1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:29,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:29,935 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:29,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4be43520 to 127.0.0.1:55741 2023-10-06 16:00:29,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:29,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x3876c8f1 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:29,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52d1a7ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:29,945 DEBUG [hconnection-0x2261f854-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:29,947 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:29,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3876c8f1 to 127.0.0.1:55741 2023-10-06 16:00:29,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:29,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-06 16:00:29,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 16:00:29,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-06 16:00:29,955 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 16:00:29,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-06 16:00:29,957 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-06 16:00:29,958 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696608629958 2023-10-06 16:00:29,958 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-06 16:00:29,961 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 16:00:29,962 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 16:00:29,962 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-06 16:00:29,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-06 16:00:29,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-10-06 16:00:29,964 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-06 16:00:29,968 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696608629968 2023-10-06 16:00:29,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,977 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-06 16:00:29,977 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:29,978 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-06 16:00:29,978 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-06 16:00:29,979 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,979 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,980 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:29,980 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:29,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:29,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:29,980 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:29,980 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:29,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:29,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:29,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,981 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:29,981 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 16:00:29,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-06 16:00:29,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-06 16:00:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-06 16:00:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,982 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-06 16:00:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,982 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-06 16:00:29,982 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-06 16:00:29,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,982 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-06 16:00:29,982 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-06 16:00:29,982 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:29,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,983 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-06 16:00:29,983 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-06 16:00:29,983 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-06 16:00:29,982 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:29,983 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:29,983 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-06 16:00:29,985 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-06 16:00:29,985 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-06 16:00:29,984 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-06 16:00:29,985 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-06 16:00:29,985 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-06 16:00:29,985 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-06 16:00:29,987 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,987 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:29,987 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:29,987 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,988 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:29,988 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,988 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:29,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:29,989 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,989 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:29,989 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:29,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:29,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:29,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-06 16:00:29,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@96b9a9[Count = 0] remaining members to acquire global barrier 2023-10-06 16:00:29,990 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-06 16:00:29,990 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,995 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,995 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,995 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-06 16:00:29,995 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:29,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,995 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 16:00:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-06 16:00:29,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 16:00:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-06 16:00:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-06 16:00:29,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 16:00:29,995 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-06 16:00:29,997 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-06 16:00:29,997 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:29,997 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-06 16:00:29,998 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-06 16:00:29,998 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:29,998 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-06 16:00:30,005 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:30,005 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:30,005 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. 2023-10-06 16:00:30,005 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. started... 2023-10-06 16:00:30,006 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69466059fc249f2470c4df953ed361f0: 2023-10-06 16:00:30,006 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,006 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:30,007 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf/6a6e28793ea94d18b5b198177453dbcc.0c862a7112bdc49982a1783d7c5a2a82->hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/cf/6a6e28793ea94d18b5b198177453dbcc-top, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf/7bb41784c6e04c94bc68b85a49d7060a.ca026a72e7becbbf6666a8d0dda33fc0->hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/cf/7bb41784c6e04c94bc68b85a49d7060a-top] hfiles 2023-10-06 16:00:30,007 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf/6a6e28793ea94d18b5b198177453dbcc.0c862a7112bdc49982a1783d7c5a2a82 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,007 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf/7bb41784c6e04c94bc68b85a49d7060a.ca026a72e7becbbf6666a8d0dda33fc0 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,014 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. completed. 2023-10-06 16:00:30,014 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. 2023-10-06 16:00:30,014 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:30,014 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:30,014 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:30,014 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-06 16:00:30,014 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 16:00:30,020 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-06 16:00:30,020 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:30,020 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:30,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:30,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:30,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:30,020 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-06 16:00:30,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:30,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:30,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:30,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:30,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:30,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:30,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:30,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:30,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:30,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,36069,1696607957508': 2023-10-06 16:00:30,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-06 16:00:30,024 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-06 16:00:30,024 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 16:00:30,024 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 16:00:30,024 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,024 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 16:00:30,025 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,025 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,025 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:30,025 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:30,025 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,026 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:30,025 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:30,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:30,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:30,026 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,026 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:30,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,027 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:30,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:30,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:30,029 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,030 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:30,030 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:30,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:30,033 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:30,033 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,033 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:30,033 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:30,033 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:30,033 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:30,033 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:30,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:30,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:30,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:30,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:30,033 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:30,033 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:30,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:30,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:30,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,033 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:30,033 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,033 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:30,034 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:30,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:30,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:30,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:30,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:30,034 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:30,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:30,034 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:30,035 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:30,035 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,035 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-06 16:00:30,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,058 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696608029958Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696608030034 (+76 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696608030034Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696608030037 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696608030049 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696608030057 (+8 ms) 2023-10-06 16:00:30,061 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-06 16:00:30,062 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:30,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 100 msec 2023-10-06 16:00:30,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-06 16:00:30,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 16:00:30,063 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608030063 2023-10-06 16:00:30,063 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34141, tgtDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608030063, rawTgtDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608030063, srcFsUri=hdfs://localhost:34141, srcDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 16:00:30,094 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 16:00:30,094 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1108850885_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608030063, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608030063/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,094 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca, snapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-06 16:00:30,104 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608030063/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:30,119 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,120 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,120 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,120 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,121 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,121 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,121 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,192 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/hadoop-3047348935280296997.jar 2023-10-06 16:00:30,192 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,192 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,193 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,193 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,193 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,194 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:30,194 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.5/hbase-shaded-miscellaneous-4.1.5.jar 2023-10-06 16:00:30,194 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.5/hbase-shaded-gson-4.1.5.jar 2023-10-06 16:00:30,195 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.5/hbase-shaded-protobuf-4.1.5.jar 2023-10-06 16:00:30,195 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.5/hbase-shaded-netty-4.1.5.jar 2023-10-06 16:00:30,195 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.5/hbase-unsafe-4.1.5.jar 2023-10-06 16:00:30,196 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 16:00:30,196 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 16:00:30,197 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 16:00:30,197 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 16:00:30,198 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 16:00:30,198 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:30,198 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:30,199 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:30,199 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:30,199 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:30,200 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:30,200 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:30,552 WARN [Listener at jenkins-hbase4.apache.org/39073] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 16:00:30,554 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-06 16:00:30,556 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-06 16:00:31,309 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 16:00:31,309 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 16:00:31,312 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0004_000001 (auth:SIMPLE) 2023-10-06 16:00:32,105 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 16:00:32,298 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0005_000001 (auth:SIMPLE) 2023-10-06 16:00:35,894 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0005_000001 (auth:SIMPLE) 2023-10-06 16:00:38,097 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0005_000001 (auth:SIMPLE) 2023-10-06 16:00:40,375 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0005_000001 (auth:SIMPLE) 2023-10-06 16:00:41,720 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 16:00:41,724 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 16:00:41,732 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:41,732 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 16:00:41,733 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 16:00:41,733 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:41,734 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-06 16:00:41,734 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-06 16:00:41,734 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608030063/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608030063/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:41,734 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608030063/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-06 16:00:41,734 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608030063/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-06 16:00:41,740 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:41,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:41,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:41,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-06 16:00:41,744 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608041744"}]},"ts":"1696608041744"} 2023-10-06 16:00:41,745 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-06 16:00:41,747 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-06 16:00:41,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69466059fc249f2470c4df953ed361f0, UNASSIGN}] 2023-10-06 16:00:41,749 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69466059fc249f2470c4df953ed361f0, UNASSIGN 2023-10-06 16:00:41,750 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=69466059fc249f2470c4df953ed361f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:41,750 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696608041750"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608041750"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608041750"}]},"ts":"1696608041750"} 2023-10-06 16:00:41,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 69466059fc249f2470c4df953ed361f0, server=jenkins-hbase4.apache.org,36069,1696607957508}] 2023-10-06 16:00:41,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-06 16:00:41,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 69466059fc249f2470c4df953ed361f0 2023-10-06 16:00:41,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 69466059fc249f2470c4df953ed361f0, disabling compactions & flushes 2023-10-06 16:00:41,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. 2023-10-06 16:00:41,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. 2023-10-06 16:00:41,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. after waiting 0 ms 2023-10-06 16:00:41,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. 2023-10-06 16:00:41,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-06 16:00:41,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:00:41,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0. 2023-10-06 16:00:41,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 69466059fc249f2470c4df953ed361f0: 2023-10-06 16:00:41,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 69466059fc249f2470c4df953ed361f0 2023-10-06 16:00:41,916 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=69466059fc249f2470c4df953ed361f0, regionState=CLOSED 2023-10-06 16:00:41,917 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696608041916"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608041916"}]},"ts":"1696608041916"} 2023-10-06 16:00:41,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-06 16:00:41,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 69466059fc249f2470c4df953ed361f0, server=jenkins-hbase4.apache.org,36069,1696607957508 in 167 msec 2023-10-06 16:00:41,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-06 16:00:41,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69466059fc249f2470c4df953ed361f0, UNASSIGN in 172 msec 2023-10-06 16:00:41,921 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608041921"}]},"ts":"1696608041921"} 2023-10-06 16:00:41,922 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-06 16:00:41,924 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-06 16:00:41,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 184 msec 2023-10-06 16:00:42,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-06 16:00:42,046 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-06 16:00:42,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,049 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,050 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,051 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,054 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:42,055 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0 2023-10-06 16:00:42,055 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:42,056 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/recovered.edits] 2023-10-06 16:00:42,057 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/recovered.edits] 2023-10-06 16:00:42,057 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/recovered.edits] 2023-10-06 16:00:42,060 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,060 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,060 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,060 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,060 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-06 16:00:42,060 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-06 16:00:42,061 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:42,061 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-06 16:00:42,061 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-06 16:00:42,061 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:42,061 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,061 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:42,061 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,061 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-06 16:00:42,062 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/cf/6a6e28793ea94d18b5b198177453dbcc to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/cf/6a6e28793ea94d18b5b198177453dbcc 2023-10-06 16:00:42,061 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-06 16:00:42,062 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:42,062 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf/6a6e28793ea94d18b5b198177453dbcc.0c862a7112bdc49982a1783d7c5a2a82 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf/6a6e28793ea94d18b5b198177453dbcc.0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:42,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:42,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-06 16:00:42,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:42,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:42,063 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:42,064 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf/7bb41784c6e04c94bc68b85a49d7060a.ca026a72e7becbbf6666a8d0dda33fc0 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/cf/7bb41784c6e04c94bc68b85a49d7060a.ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:42,065 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/cf/7bb41784c6e04c94bc68b85a49d7060a to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/cf/7bb41784c6e04c94bc68b85a49d7060a 2023-10-06 16:00:42,066 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/recovered.edits/8.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82/recovered.edits/8.seqid 2023-10-06 16:00:42,067 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0c862a7112bdc49982a1783d7c5a2a82 2023-10-06 16:00:42,067 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/recovered.edits/12.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0/recovered.edits/12.seqid 2023-10-06 16:00:42,067 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/recovered.edits/8.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0/recovered.edits/8.seqid 2023-10-06 16:00:42,068 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69466059fc249f2470c4df953ed361f0 2023-10-06 16:00:42,068 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ca026a72e7becbbf6666a8d0dda33fc0 2023-10-06 16:00:42,068 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-06 16:00:42,070 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,072 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-06 16:00:42,073 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-06 16:00:42,074 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,074 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-06 16:00:42,074 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696608042074"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:42,075 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-06 16:00:42,076 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 69466059fc249f2470c4df953ed361f0, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696608028175.69466059fc249f2470c4df953ed361f0.', STARTKEY => '', ENDKEY => ''}] 2023-10-06 16:00:42,076 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-06 16:00:42,076 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696608042076"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:42,077 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-06 16:00:42,078 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-10-06 16:00:42,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-06 16:00:42,164 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-06 16:00:42,164 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-06 16:00:42,168 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608042168"}]},"ts":"1696608042168"} 2023-10-06 16:00:42,170 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-06 16:00:42,171 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-06 16:00:42,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8a39adac605576ebdfc0db8adf758a3c, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e7a5c3a99e05dbbf25ba0f5e13fcd893, UNASSIGN}] 2023-10-06 16:00:42,174 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8a39adac605576ebdfc0db8adf758a3c, UNASSIGN 2023-10-06 16:00:42,174 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e7a5c3a99e05dbbf25ba0f5e13fcd893, UNASSIGN 2023-10-06 16:00:42,174 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=8a39adac605576ebdfc0db8adf758a3c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:42,174 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=e7a5c3a99e05dbbf25ba0f5e13fcd893, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:42,175 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696608042174"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608042174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608042174"}]},"ts":"1696608042174"} 2023-10-06 16:00:42,175 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696608042174"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608042174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608042174"}]},"ts":"1696608042174"} 2023-10-06 16:00:42,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 8a39adac605576ebdfc0db8adf758a3c, server=jenkins-hbase4.apache.org,32989,1696607957469}] 2023-10-06 16:00:42,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure e7a5c3a99e05dbbf25ba0f5e13fcd893, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 16:00:42,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-06 16:00:42,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:42,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8a39adac605576ebdfc0db8adf758a3c, disabling compactions & flushes 2023-10-06 16:00:42,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:42,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:42,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. after waiting 0 ms 2023-10-06 16:00:42,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:42,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:42,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e7a5c3a99e05dbbf25ba0f5e13fcd893, disabling compactions & flushes 2023-10-06 16:00:42,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:42,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:42,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. after waiting 0 ms 2023-10-06 16:00:42,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:42,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 16:00:42,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:00:42,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c. 2023-10-06 16:00:42,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 16:00:42,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8a39adac605576ebdfc0db8adf758a3c: 2023-10-06 16:00:42,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:00:42,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893. 2023-10-06 16:00:42,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e7a5c3a99e05dbbf25ba0f5e13fcd893: 2023-10-06 16:00:42,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:42,344 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=8a39adac605576ebdfc0db8adf758a3c, regionState=CLOSED 2023-10-06 16:00:42,344 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696608042344"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608042344"}]},"ts":"1696608042344"} 2023-10-06 16:00:42,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:42,345 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=e7a5c3a99e05dbbf25ba0f5e13fcd893, regionState=CLOSED 2023-10-06 16:00:42,345 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696608042345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608042345"}]},"ts":"1696608042345"} 2023-10-06 16:00:42,348 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-06 16:00:42,348 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 8a39adac605576ebdfc0db8adf758a3c, server=jenkins-hbase4.apache.org,32989,1696607957469 in 170 msec 2023-10-06 16:00:42,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-06 16:00:42,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure e7a5c3a99e05dbbf25ba0f5e13fcd893, server=jenkins-hbase4.apache.org,41607,1696607957421 in 171 msec 2023-10-06 16:00:42,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8a39adac605576ebdfc0db8adf758a3c, UNASSIGN in 176 msec 2023-10-06 16:00:42,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-10-06 16:00:42,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e7a5c3a99e05dbbf25ba0f5e13fcd893, UNASSIGN in 176 msec 2023-10-06 16:00:42,350 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608042350"}]},"ts":"1696608042350"} 2023-10-06 16:00:42,351 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-06 16:00:42,354 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-06 16:00:42,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 191 msec 2023-10-06 16:00:42,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-06 16:00:42,470 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-06 16:00:42,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,474 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,475 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,476 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,479 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,479 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,479 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,479 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:42,479 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:42,479 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 16:00:42,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 16:00:42,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 16:00:42,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-06 16:00:42,481 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,481 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,481 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:42,481 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,481 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:42,481 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,481 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:42,481 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:42,481 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/recovered.edits] 2023-10-06 16:00:42,481 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/recovered.edits] 2023-10-06 16:00:42,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-06 16:00:42,485 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/cf/65b15ce9571d4be9a2195e6c2a492a3f to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/cf/65b15ce9571d4be9a2195e6c2a492a3f 2023-10-06 16:00:42,486 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/cf/e240bbf4bddb4d1bbf27362875bea0b4 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/cf/e240bbf4bddb4d1bbf27362875bea0b4 2023-10-06 16:00:42,488 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c/recovered.edits/9.seqid 2023-10-06 16:00:42,489 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893/recovered.edits/9.seqid 2023-10-06 16:00:42,489 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8a39adac605576ebdfc0db8adf758a3c 2023-10-06 16:00:42,489 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e7a5c3a99e05dbbf25ba0f5e13fcd893 2023-10-06 16:00:42,489 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-06 16:00:42,490 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-06 16:00:42,490 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-06 16:00:42,493 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310067d68fec3d95f4afdb16fb4733dca5ba7 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202310067d68fec3d95f4afdb16fb4733dca5ba7 2023-10-06 16:00:42,494 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231006a813395ff2344ffc9c4eecb0842cf5f8 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20231006a813395ff2344ffc9c4eecb0842cf5f8 2023-10-06 16:00:42,495 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-06 16:00:42,497 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,498 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-06 16:00:42,500 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-06 16:00:42,501 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,501 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-06 16:00:42,501 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696608042501"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:42,501 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696608042501"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:42,502 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 16:00:42,502 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8a39adac605576ebdfc0db8adf758a3c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696608026821.8a39adac605576ebdfc0db8adf758a3c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e7a5c3a99e05dbbf25ba0f5e13fcd893, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696608026821.e7a5c3a99e05dbbf25ba0f5e13fcd893.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 16:00:42,502 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-06 16:00:42,503 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696608042502"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:42,504 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-06 16:00:42,507 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-10-06 16:00:42,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-06 16:00:42,583 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-06 16:00:42,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-06 16:00:42,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-06 16:00:42,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-06 16:00:42,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-06 16:00:42,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-06 16:00:42,622 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 744) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:33134 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:58904 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_858187850_1 at /127.0.0.1:40056 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:40076 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (209246710) connection to jenkins-hbase4.apache.org/172.31.14.131:42709 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4069 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_858187850_1 at /127.0.0.1:33112 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 262) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=2245 (was 2289) 2023-10-06 16:00:42,622 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-10-06 16:00:42,640 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=166, AvailableMemoryMB=2244 2023-10-06 16:00:42,641 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-10-06 16:00:42,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 16:00:42,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 16:00:42,644 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 16:00:42,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-06 16:00:42,645 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 16:00:42,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 16:00:42,647 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:42,647 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:42,647 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569 empty. 2023-10-06 16:00:42,647 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50 empty. 2023-10-06 16:00:42,648 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:42,648 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:42,648 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-06 16:00:42,656 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-06 16:00:42,657 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 15d07e438b5997b386e3ff02356cf569, NAME => 'testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 16:00:42,658 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 29dcf8f917f082360d39b6a6f8034c50, NAME => 'testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 16:00:42,665 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:42,665 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 15d07e438b5997b386e3ff02356cf569, disabling compactions & flushes 2023-10-06 16:00:42,665 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:42,665 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:42,665 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. after waiting 0 ms 2023-10-06 16:00:42,665 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:42,665 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:42,665 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 15d07e438b5997b386e3ff02356cf569: 2023-10-06 16:00:42,666 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:42,666 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 29dcf8f917f082360d39b6a6f8034c50, disabling compactions & flushes 2023-10-06 16:00:42,666 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:42,666 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:42,666 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. after waiting 0 ms 2023-10-06 16:00:42,666 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:42,666 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:42,666 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 29dcf8f917f082360d39b6a6f8034c50: 2023-10-06 16:00:42,668 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 16:00:42,669 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696608042669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608042669"}]},"ts":"1696608042669"} 2023-10-06 16:00:42,669 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696608042669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608042669"}]},"ts":"1696608042669"} 2023-10-06 16:00:42,671 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 16:00:42,672 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 16:00:42,672 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608042672"}]},"ts":"1696608042672"} 2023-10-06 16:00:42,673 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-06 16:00:42,676 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 16:00:42,677 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 16:00:42,677 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 16:00:42,677 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 16:00:42,677 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 16:00:42,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15d07e438b5997b386e3ff02356cf569, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=29dcf8f917f082360d39b6a6f8034c50, ASSIGN}] 2023-10-06 16:00:42,680 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=29dcf8f917f082360d39b6a6f8034c50, ASSIGN 2023-10-06 16:00:42,680 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15d07e438b5997b386e3ff02356cf569, ASSIGN 2023-10-06 16:00:42,681 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=29dcf8f917f082360d39b6a6f8034c50, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41607,1696607957421; forceNewPlan=false, retain=false 2023-10-06 16:00:42,681 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15d07e438b5997b386e3ff02356cf569, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36069,1696607957508; forceNewPlan=false, retain=false 2023-10-06 16:00:42,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 16:00:42,831 INFO [jenkins-hbase4:45793] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 16:00:42,834 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=15d07e438b5997b386e3ff02356cf569, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:42,834 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=29dcf8f917f082360d39b6a6f8034c50, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:42,834 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696608042834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608042834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608042834"}]},"ts":"1696608042834"} 2023-10-06 16:00:42,834 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696608042834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608042834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608042834"}]},"ts":"1696608042834"} 2023-10-06 16:00:42,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 15d07e438b5997b386e3ff02356cf569, server=jenkins-hbase4.apache.org,36069,1696607957508}] 2023-10-06 16:00:42,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 29dcf8f917f082360d39b6a6f8034c50, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 16:00:42,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 16:00:42,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:42,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:42,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 15d07e438b5997b386e3ff02356cf569, NAME => 'testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 16:00:42,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 29dcf8f917f082360d39b6a6f8034c50, NAME => 'testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 16:00:42,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. service=AccessControlService 2023-10-06 16:00:42,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. service=AccessControlService 2023-10-06 16:00:42,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 16:00:42,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 16:00:42,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:42,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:42,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:42,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:42,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:42,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:42,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:42,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:42,992 INFO [StoreOpener-29dcf8f917f082360d39b6a6f8034c50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:42,992 INFO [StoreOpener-15d07e438b5997b386e3ff02356cf569-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:42,994 DEBUG [StoreOpener-15d07e438b5997b386e3ff02356cf569-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/cf 2023-10-06 16:00:42,994 DEBUG [StoreOpener-15d07e438b5997b386e3ff02356cf569-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/cf 2023-10-06 16:00:42,994 DEBUG [StoreOpener-29dcf8f917f082360d39b6a6f8034c50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/cf 2023-10-06 16:00:42,994 DEBUG [StoreOpener-29dcf8f917f082360d39b6a6f8034c50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/cf 2023-10-06 16:00:42,994 INFO [StoreOpener-15d07e438b5997b386e3ff02356cf569-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15d07e438b5997b386e3ff02356cf569 columnFamilyName cf 2023-10-06 16:00:42,994 INFO [StoreOpener-29dcf8f917f082360d39b6a6f8034c50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29dcf8f917f082360d39b6a6f8034c50 columnFamilyName cf 2023-10-06 16:00:42,995 INFO [StoreOpener-15d07e438b5997b386e3ff02356cf569-1] regionserver.HStore(310): Store=15d07e438b5997b386e3ff02356cf569/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 16:00:42,995 INFO [StoreOpener-29dcf8f917f082360d39b6a6f8034c50-1] regionserver.HStore(310): Store=29dcf8f917f082360d39b6a6f8034c50/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 16:00:42,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:42,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:42,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:42,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:43,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:43,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:43,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 16:00:43,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 16:00:43,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 15d07e438b5997b386e3ff02356cf569; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58945204, jitterRate=-0.12164801359176636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 16:00:43,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 29dcf8f917f082360d39b6a6f8034c50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74879875, jitterRate=0.11579708755016327}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 16:00:43,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 15d07e438b5997b386e3ff02356cf569: 2023-10-06 16:00:43,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 29dcf8f917f082360d39b6a6f8034c50: 2023-10-06 16:00:43,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50., pid=94, masterSystemTime=1696608042988 2023-10-06 16:00:43,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569., pid=93, masterSystemTime=1696608042987 2023-10-06 16:00:43,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:43,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:43,006 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=29dcf8f917f082360d39b6a6f8034c50, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:43,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:43,006 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696608043005"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696608043005"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696608043005"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696608043005"}]},"ts":"1696608043005"} 2023-10-06 16:00:43,006 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=15d07e438b5997b386e3ff02356cf569, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,006 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696608043006"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696608043006"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696608043006"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696608043006"}]},"ts":"1696608043006"} 2023-10-06 16:00:43,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-10-06 16:00:43,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 29dcf8f917f082360d39b6a6f8034c50, server=jenkins-hbase4.apache.org,41607,1696607957421 in 171 msec 2023-10-06 16:00:43,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-06 16:00:43,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 15d07e438b5997b386e3ff02356cf569, server=jenkins-hbase4.apache.org,36069,1696607957508 in 173 msec 2023-10-06 16:00:43,010 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=29dcf8f917f082360d39b6a6f8034c50, ASSIGN in 331 msec 2023-10-06 16:00:43,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-10-06 16:00:43,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15d07e438b5997b386e3ff02356cf569, ASSIGN in 332 msec 2023-10-06 16:00:43,012 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 16:00:43,012 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608043012"}]},"ts":"1696608043012"} 2023-10-06 16:00:43,013 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-06 16:00:43,015 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 16:00:43,016 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-06 16:00:43,017 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 16:00:43,019 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:43,020 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:43,020 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:43,020 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:43,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:43,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:43,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:43,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:43,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 379 msec 2023-10-06 16:00:43,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-06 16:00:43,249 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-06 16:00:43,251 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-06 16:00:43,251 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:43,253 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 16:00:43,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 16:00:43,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696608043263 (current time:1696608043263). 2023-10-06 16:00:43,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 16:00:43,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x75a62319 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:43,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7606e6ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:43,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:43,277 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:43,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75a62319 to 127.0.0.1:55741 2023-10-06 16:00:43,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:43,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x1e422819 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:43,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ab86e23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:43,287 DEBUG [hconnection-0x1bc8da05-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:43,288 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:43,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e422819 to 127.0.0.1:55741 2023-10-06 16:00:43,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:43,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 16:00:43,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 16:00:43,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 16:00:43,296 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 16:00:43,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 16:00:43,301 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 16:00:43,302 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696608643302 2023-10-06 16:00:43,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 16:00:43,302 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-06 16:00:43,303 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 16:00:43,303 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 16:00:43,304 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 16:00:43,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 16:00:43,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-06 16:00:43,307 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 16:00:43,308 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696608643308 2023-10-06 16:00:43,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,316 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-06 16:00:43,316 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:43,317 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-06 16:00:43,317 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-06 16:00:43,318 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,318 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,327 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,327 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,327 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,327 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,327 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,327 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,328 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,328 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 16:00:43,328 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 16:00:43,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,329 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 16:00:43,329 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 16:00:43,329 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:43,329 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:43,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,331 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 16:00:43,331 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 16:00:43,331 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:43,331 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 16:00:43,331 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 16:00:43,330 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 16:00:43,331 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 16:00:43,332 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 16:00:43,332 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 16:00:43,332 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 16:00:43,332 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 16:00:43,333 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,333 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:43,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:43,334 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:43,334 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,334 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:43,334 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,334 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:43,334 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,334 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,335 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:43,335 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:43,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:43,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 16:00:43,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4718c752[Count = 1] remaining members to acquire global barrier 2023-10-06 16:00:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:43,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 16:00:43,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4718c752[Count = 0] remaining members to acquire global barrier 2023-10-06 16:00:43,338 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 16:00:43,338 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,339 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,339 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,339 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 16:00:43,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,339 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 16:00:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 16:00:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 16:00:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 16:00:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:43,340 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:43,340 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:43,340 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. started... 2023-10-06 16:00:43,340 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. started... 2023-10-06 16:00:43,340 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:43,340 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,341 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 16:00:43,341 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 29dcf8f917f082360d39b6a6f8034c50: 2023-10-06 16:00:43,340 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15d07e438b5997b386e3ff02356cf569: 2023-10-06 16:00:43,341 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,341 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,342 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:43,342 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:43,342 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 16:00:43,342 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 16:00:43,343 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 16:00:43,343 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:43,343 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 16:00:43,352 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. completed. 2023-10-06 16:00:43,352 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:43,352 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:43,352 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:43,352 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. completed. 2023-10-06 16:00:43,352 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,353 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:43,353 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 16:00:43,353 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:43,353 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 16:00:43,353 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:43,353 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,353 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 16:00:43,353 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 16:00:43,354 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 16:00:43,354 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,354 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:43,354 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 16:00:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:43,356 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,356 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 16:00:43,356 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:43,356 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 16:00:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41607,1696607957421': 2023-10-06 16:00:43,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 16:00:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:43,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36069,1696607957508': 2023-10-06 16:00:43,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 16:00:43,362 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-06 16:00:43,362 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 16:00:43,362 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 16:00:43,362 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,362 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 16:00:43,364 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,364 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,364 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,364 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,364 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,364 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,364 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,365 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:43,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,364 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,365 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:43,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:43,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,367 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,367 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,367 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:43,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,372 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:43,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,372 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,372 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,372 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,371 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,373 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-06 16:00:43,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,373 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 16:00:43,373 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,373 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,373 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,373 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,373 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,373 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 16:00:43,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,396 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-06 16:00:43,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,397 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696608043302Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696608043381 (+79 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696608043381Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696608043381Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696608043384 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696608043391 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696608043396 (+5 ms) 2023-10-06 16:00:43,399 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 16:00:43,400 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 96 msec 2023-10-06 16:00:43,403 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:43,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 16:00:43,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 16:00:43,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36069] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 16:00:43,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41607] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 16:00:43,410 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-06 16:00:43,410 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:43,410 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 16:00:43,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 16:00:43,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696608043419 (current time:1696608043419). 2023-10-06 16:00:43,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 16:00:43,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x08d32b69 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:43,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dec6300, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:43,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:43,428 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:43,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08d32b69 to 127.0.0.1:55741 2023-10-06 16:00:43,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:43,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x0fcc6607 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:43,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e559cf4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:43,438 DEBUG [hconnection-0xbf185d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:43,441 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:43,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fcc6607 to 127.0.0.1:55741 2023-10-06 16:00:43,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:43,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-06 16:00:43,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 16:00:43,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 16:00:43,448 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 16:00:43,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 16:00:43,450 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 16:00:43,451 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696608643451 2023-10-06 16:00:43,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-06 16:00:43,451 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-06 16:00:43,452 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 16:00:43,452 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 16:00:43,454 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-06 16:00:43,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 16:00:43,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-10-06 16:00:43,456 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 16:00:43,456 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696608643456 2023-10-06 16:00:43,457 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-06 16:00:43,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,469 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-06 16:00:43,469 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:43,470 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-06 16:00:43,470 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-06 16:00:43,471 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,471 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,472 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,472 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,472 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,472 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,472 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,472 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,473 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,473 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,473 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 16:00:43,474 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-06 16:00:43,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,474 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 16:00:43,474 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 16:00:43,474 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:43,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,475 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 16:00:43,475 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 16:00:43,475 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-06 16:00:43,474 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:43,475 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:43,475 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 16:00:43,476 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 16:00:43,479 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-06 16:00:43,479 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 16:00:43,479 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-06 16:00:43,479 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 16:00:43,479 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-06 16:00:43,481 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,482 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:43,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:43,482 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:43,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:43,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:43,483 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,483 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:43,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:43,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 16:00:43,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cf65b6a[Count = 1] remaining members to acquire global barrier 2023-10-06 16:00:43,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:43,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:43,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:43,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:43,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:43,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-06 16:00:43,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cf65b6a[Count = 0] remaining members to acquire global barrier 2023-10-06 16:00:43,487 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-06 16:00:43,487 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,492 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,492 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,492 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,492 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,492 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 16:00:43,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,492 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 16:00:43,492 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-06 16:00:43,492 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 16:00:43,492 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 16:00:43,492 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,492 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:43,492 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 16:00:43,492 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:43,493 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:43,492 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:43,493 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:43,492 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:43,492 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. started... 2023-10-06 16:00:43,493 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. started... 2023-10-06 16:00:43,493 INFO [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 15d07e438b5997b386e3ff02356cf569 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-06 16:00:43,493 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 29dcf8f917f082360d39b6a6f8034c50 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-06 16:00:43,494 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 16:00:43,494 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:43,494 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 16:00:43,509 INFO [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310069ae48630c9fc467297ad66367d5b36b2 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310069ae48630c9fc467297ad66367d5b36b2 2023-10-06 16:00:43,510 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231006e9f5cec8657b4ca485f51948b1430624 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231006e9f5cec8657b4ca485f51948b1430624 2023-10-06 16:00:43,521 INFO [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/.tmp/cf/3969d7165b20485ba4c7d684498b9a0d 2023-10-06 16:00:43,523 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/.tmp/cf/57a1f13266e449d1be02743d2a9bbb61 2023-10-06 16:00:43,526 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/.tmp/cf/3969d7165b20485ba4c7d684498b9a0d as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/cf/3969d7165b20485ba4c7d684498b9a0d 2023-10-06 16:00:43,528 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/.tmp/cf/57a1f13266e449d1be02743d2a9bbb61 as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/cf/57a1f13266e449d1be02743d2a9bbb61 2023-10-06 16:00:43,531 INFO [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/cf/3969d7165b20485ba4c7d684498b9a0d, entries=4, sequenceid=6, filesize=5.6 K 2023-10-06 16:00:43,532 INFO [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 15d07e438b5997b386e3ff02356cf569 in 39ms, sequenceid=6, compaction requested=false 2023-10-06 16:00:43,533 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 15d07e438b5997b386e3ff02356cf569: 2023-10-06 16:00:43,534 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,534 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/cf/57a1f13266e449d1be02743d2a9bbb61, entries=46, sequenceid=6, filesize=12.9 K 2023-10-06 16:00:43,534 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:43,534 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/cf/3969d7165b20485ba4c7d684498b9a0d] hfiles 2023-10-06 16:00:43,534 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/cf/3969d7165b20485ba4c7d684498b9a0d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,534 INFO [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 29dcf8f917f082360d39b6a6f8034c50 in 41ms, sequenceid=6, compaction requested=false 2023-10-06 16:00:43,535 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 29dcf8f917f082360d39b6a6f8034c50: 2023-10-06 16:00:43,535 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,536 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:43,536 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/cf/57a1f13266e449d1be02743d2a9bbb61] hfiles 2023-10-06 16:00:43,536 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/cf/57a1f13266e449d1be02743d2a9bbb61 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,546 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. completed. 2023-10-06 16:00:43,546 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:43,546 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:43,546 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:43,546 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,546 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 16:00:43,546 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 16:00:43,547 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. completed. 2023-10-06 16:00:43,547 DEBUG [rs(jenkins-hbase4.apache.org,41607,1696607957421)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:43,547 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:43,547 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:43,547 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,548 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-06 16:00:43,548 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 16:00:43,548 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,548 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 16:00:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:43,548 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:43,548 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 16:00:43,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:43,550 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-06 16:00:43,550 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:43,550 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:43,550 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-06 16:00:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:43,553 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 16:00:43,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-06 16:00:43,554 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 16:00:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36069,1696607957508': 2023-10-06 16:00:43,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-06 16:00:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:43,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41607,1696607957421': 2023-10-06 16:00:43,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-06 16:00:43,557 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-06 16:00:43,557 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 16:00:43,557 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 16:00:43,557 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,557 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 16:00:43,559 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,559 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,559 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:43,559 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,559 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,559 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,560 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,560 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:43,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,560 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,561 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,562 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:43,562 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,563 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,565 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,565 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,565 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,565 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,565 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,565 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,565 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,565 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:43,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-06 16:00:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,565 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:43,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,565 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 16:00:43,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:43,567 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,567 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,567 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:43,567 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,567 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:43,567 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:43,567 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,567 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231006e9f5cec8657b4ca485f51948b1430624, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310069ae48630c9fc467297ad66367d5b36b2] mob files 2023-10-06 16:00:43,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231006e9f5cec8657b4ca485f51948b1430624 2023-10-06 16:00:43,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310069ae48630c9fc467297ad66367d5b36b2 2023-10-06 16:00:43,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,591 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-06 16:00:43,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,591 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696608043451Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696608043574 (+123 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696608043574Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696608043574Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696608043577 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696608043584 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696608043591 (+7 ms) 2023-10-06 16:00:43,596 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-06 16:00:43,598 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 144 msec 2023-10-06 16:00:43,754 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:43,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-06 16:00:43,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 16:00:43,755 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608043755 2023-10-06 16:00:43,755 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34141, tgtDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608043755, rawTgtDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608043755, srcFsUri=hdfs://localhost:34141, srcDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 16:00:43,777 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 16:00:43,777 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1602375458_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608043755, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608043755/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,777 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca, snapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-06 16:00:43,781 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608043755/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:43,800 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,801 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,801 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,801 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,802 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,802 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,802 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,869 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/hadoop-2032546060530493847.jar 2023-10-06 16:00:43,869 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,870 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,870 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,870 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,870 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,871 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:43,871 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.5/hbase-shaded-miscellaneous-4.1.5.jar 2023-10-06 16:00:43,871 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.5/hbase-shaded-gson-4.1.5.jar 2023-10-06 16:00:43,872 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.5/hbase-shaded-protobuf-4.1.5.jar 2023-10-06 16:00:43,872 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.5/hbase-shaded-netty-4.1.5.jar 2023-10-06 16:00:43,872 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.5/hbase-unsafe-4.1.5.jar 2023-10-06 16:00:43,873 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 16:00:43,873 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 16:00:43,873 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 16:00:43,874 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 16:00:43,874 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 16:00:43,874 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:43,875 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:43,875 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:43,875 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:43,875 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:43,876 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:43,876 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:44,231 WARN [Listener at jenkins-hbase4.apache.org/39073] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 16:00:44,233 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-06 16:00:46,548 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 16:00:46,548 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 16:00:46,550 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0005_000001 (auth:SIMPLE) 2023-10-06 16:00:47,319 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0006_000001 (auth:SIMPLE) 2023-10-06 16:00:47,491 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 16:00:50,911 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0006_000001 (auth:SIMPLE) 2023-10-06 16:00:53,560 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 16:00:53,561 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 16:00:53,566 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:53,566 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 16:00:53,566 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 16:00:53,566 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:53,567 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-06 16:00:53,567 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-06 16:00:53,567 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608043755/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608043755/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:53,567 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608043755/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-06 16:00:53,567 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608043755/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-06 16:00:53,572 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-06 16:00:53,576 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608053576"}]},"ts":"1696608053576"} 2023-10-06 16:00:53,577 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-06 16:00:53,580 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-06 16:00:53,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15d07e438b5997b386e3ff02356cf569, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=29dcf8f917f082360d39b6a6f8034c50, UNASSIGN}] 2023-10-06 16:00:53,583 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15d07e438b5997b386e3ff02356cf569, UNASSIGN 2023-10-06 16:00:53,583 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=29dcf8f917f082360d39b6a6f8034c50, UNASSIGN 2023-10-06 16:00:53,583 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=15d07e438b5997b386e3ff02356cf569, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:53,583 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=29dcf8f917f082360d39b6a6f8034c50, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:53,583 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696608053583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608053583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608053583"}]},"ts":"1696608053583"} 2023-10-06 16:00:53,583 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696608053583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608053583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608053583"}]},"ts":"1696608053583"} 2023-10-06 16:00:53,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 15d07e438b5997b386e3ff02356cf569, server=jenkins-hbase4.apache.org,36069,1696607957508}] 2023-10-06 16:00:53,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 29dcf8f917f082360d39b6a6f8034c50, server=jenkins-hbase4.apache.org,41607,1696607957421}] 2023-10-06 16:00:53,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-06 16:00:53,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:53,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:53,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 29dcf8f917f082360d39b6a6f8034c50, disabling compactions & flushes 2023-10-06 16:00:53,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:53,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 15d07e438b5997b386e3ff02356cf569, disabling compactions & flushes 2023-10-06 16:00:53,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:53,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:53,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:53,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. after waiting 0 ms 2023-10-06 16:00:53,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:53,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. after waiting 0 ms 2023-10-06 16:00:53,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:53,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 16:00:53,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 16:00:53,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:00:53,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:00:53,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569. 2023-10-06 16:00:53,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 15d07e438b5997b386e3ff02356cf569: 2023-10-06 16:00:53,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50. 2023-10-06 16:00:53,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 29dcf8f917f082360d39b6a6f8034c50: 2023-10-06 16:00:53,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:53,748 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=15d07e438b5997b386e3ff02356cf569, regionState=CLOSED 2023-10-06 16:00:53,748 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696608053748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608053748"}]},"ts":"1696608053748"} 2023-10-06 16:00:53,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:53,749 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=29dcf8f917f082360d39b6a6f8034c50, regionState=CLOSED 2023-10-06 16:00:53,749 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696608053749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608053749"}]},"ts":"1696608053749"} 2023-10-06 16:00:53,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-06 16:00:53,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 15d07e438b5997b386e3ff02356cf569, server=jenkins-hbase4.apache.org,36069,1696607957508 in 165 msec 2023-10-06 16:00:53,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-06 16:00:53,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 29dcf8f917f082360d39b6a6f8034c50, server=jenkins-hbase4.apache.org,41607,1696607957421 in 165 msec 2023-10-06 16:00:53,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=15d07e438b5997b386e3ff02356cf569, UNASSIGN in 170 msec 2023-10-06 16:00:53,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-06 16:00:53,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=29dcf8f917f082360d39b6a6f8034c50, UNASSIGN in 171 msec 2023-10-06 16:00:53,753 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608053753"}]},"ts":"1696608053753"} 2023-10-06 16:00:53,754 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-06 16:00:53,756 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-06 16:00:53,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 185 msec 2023-10-06 16:00:53,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-06 16:00:53,879 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-06 16:00:53,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,883 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,883 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,885 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,887 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,887 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,887 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,887 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 16:00:53,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 16:00:53,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 16:00:53,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-06 16:00:53,888 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:53,888 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:53,889 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,889 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,889 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:53,889 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,889 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,890 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:53,889 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:53,890 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:53,890 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/recovered.edits] 2023-10-06 16:00:53,890 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/recovered.edits] 2023-10-06 16:00:53,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-06 16:00:53,894 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/cf/57a1f13266e449d1be02743d2a9bbb61 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/cf/57a1f13266e449d1be02743d2a9bbb61 2023-10-06 16:00:53,894 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/cf/3969d7165b20485ba4c7d684498b9a0d to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/cf/3969d7165b20485ba4c7d684498b9a0d 2023-10-06 16:00:53,897 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50/recovered.edits/9.seqid 2023-10-06 16:00:53,897 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569/recovered.edits/9.seqid 2023-10-06 16:00:53,898 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/29dcf8f917f082360d39b6a6f8034c50 2023-10-06 16:00:53,898 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testEmptyExportFileSystemState/15d07e438b5997b386e3ff02356cf569 2023-10-06 16:00:53,898 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-06 16:00:53,898 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-06 16:00:53,899 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-06 16:00:53,902 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231006e9f5cec8657b4ca485f51948b1430624 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231006e9f5cec8657b4ca485f51948b1430624 2023-10-06 16:00:53,903 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310069ae48630c9fc467297ad66367d5b36b2 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202310069ae48630c9fc467297ad66367d5b36b2 2023-10-06 16:00:53,904 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-06 16:00:53,906 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,908 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-06 16:00:53,910 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-06 16:00:53,910 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,910 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-06 16:00:53,911 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696608053911"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:53,911 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696608053911"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:53,912 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 16:00:53,912 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 15d07e438b5997b386e3ff02356cf569, NAME => 'testtb-testEmptyExportFileSystemState,,1696608042642.15d07e438b5997b386e3ff02356cf569.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 29dcf8f917f082360d39b6a6f8034c50, NAME => 'testtb-testEmptyExportFileSystemState,1,1696608042642.29dcf8f917f082360d39b6a6f8034c50.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 16:00:53,912 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-06 16:00:53,912 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696608053912"}]},"ts":"9223372036854775807"} 2023-10-06 16:00:53,914 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-06 16:00:53,916 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-06 16:00:53,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 36 msec 2023-10-06 16:00:53,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-06 16:00:53,992 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-06 16:00:53,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-06 16:00:54,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:54,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-06 16:00:54,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-06 16:00:54,027 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 760) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1513413999_1 at /127.0.0.1:60274 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1513413999_1 at /127.0.0.1:35448 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:35506 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (209246710) connection to jenkins-hbase4.apache.org/172.31.14.131:37057 from appattempt_1696607963643_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:60308 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1929154419_17 at /127.0.0.1:46050 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4725 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (209246710) connection to jenkins-hbase4.apache.org/172.31.14.131:34229 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x616e7-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x616e7-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (209246710) connection to jenkins-hbase4.apache.org/172.31.14.131:40635 from appattempt_1696607963643_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=923 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=259 (was 288), ProcessCount=167 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=2218 (was 2244) 2023-10-06 16:00:54,027 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-06 16:00:54,046 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=259, ProcessCount=167, AvailableMemoryMB=2218 2023-10-06 16:00:54,046 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-06 16:00:54,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-06 16:00:54,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,050 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-06 16:00:54,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-06 16:00:54,051 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-06 16:00:54,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 16:00:54,053 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:00:54,053 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:00:54,053 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c empty. 2023-10-06 16:00:54,053 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da empty. 2023-10-06 16:00:54,054 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:00:54,054 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:00:54,054 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-06 16:00:54,062 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-06 16:00:54,063 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0a1cd66f8811f443c1b43b84a9308f9c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 16:00:54,064 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => bb0da2a90d4894a9004cf3f0293199da, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing bb0da2a90d4894a9004cf3f0293199da, disabling compactions & flushes 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 0a1cd66f8811f443c1b43b84a9308f9c, disabling compactions & flushes 2023-10-06 16:00:54,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:00:54,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. after waiting 0 ms 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. after waiting 0 ms 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:54,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:00:54,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for bb0da2a90d4894a9004cf3f0293199da: 2023-10-06 16:00:54,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 0a1cd66f8811f443c1b43b84a9308f9c: 2023-10-06 16:00:54,082 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-06 16:00:54,082 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696608054082"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608054082"}]},"ts":"1696608054082"} 2023-10-06 16:00:54,082 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696608054082"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608054082"}]},"ts":"1696608054082"} 2023-10-06 16:00:54,084 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-06 16:00:54,085 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-06 16:00:54,085 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608054085"}]},"ts":"1696608054085"} 2023-10-06 16:00:54,086 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-06 16:00:54,089 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-06 16:00:54,090 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-06 16:00:54,090 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-06 16:00:54,090 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-06 16:00:54,091 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-06 16:00:54,091 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a1cd66f8811f443c1b43b84a9308f9c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb0da2a90d4894a9004cf3f0293199da, ASSIGN}] 2023-10-06 16:00:54,093 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb0da2a90d4894a9004cf3f0293199da, ASSIGN 2023-10-06 16:00:54,093 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a1cd66f8811f443c1b43b84a9308f9c, ASSIGN 2023-10-06 16:00:54,094 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb0da2a90d4894a9004cf3f0293199da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32989,1696607957469; forceNewPlan=false, retain=false 2023-10-06 16:00:54,094 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a1cd66f8811f443c1b43b84a9308f9c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36069,1696607957508; forceNewPlan=false, retain=false 2023-10-06 16:00:54,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 16:00:54,244 INFO [jenkins-hbase4:45793] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-06 16:00:54,247 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=bb0da2a90d4894a9004cf3f0293199da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,247 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=0a1cd66f8811f443c1b43b84a9308f9c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,247 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696608054247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608054247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608054247"}]},"ts":"1696608054247"} 2023-10-06 16:00:54,247 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696608054247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608054247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608054247"}]},"ts":"1696608054247"} 2023-10-06 16:00:54,249 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure bb0da2a90d4894a9004cf3f0293199da, server=jenkins-hbase4.apache.org,32989,1696607957469}] 2023-10-06 16:00:54,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 0a1cd66f8811f443c1b43b84a9308f9c, server=jenkins-hbase4.apache.org,36069,1696607957508}] 2023-10-06 16:00:54,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 16:00:54,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:00:54,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:54,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb0da2a90d4894a9004cf3f0293199da, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.', STARTKEY => '1', ENDKEY => ''} 2023-10-06 16:00:54,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a1cd66f8811f443c1b43b84a9308f9c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.', STARTKEY => '', ENDKEY => '1'} 2023-10-06 16:00:54,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. service=AccessControlService 2023-10-06 16:00:54,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. service=AccessControlService 2023-10-06 16:00:54,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 16:00:54,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-06 16:00:54,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:00:54,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:00:54,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:54,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-06 16:00:54,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:00:54,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:00:54,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:00:54,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:00:54,405 INFO [StoreOpener-bb0da2a90d4894a9004cf3f0293199da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:00:54,405 INFO [StoreOpener-0a1cd66f8811f443c1b43b84a9308f9c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:00:54,406 DEBUG [StoreOpener-bb0da2a90d4894a9004cf3f0293199da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/cf 2023-10-06 16:00:54,406 DEBUG [StoreOpener-0a1cd66f8811f443c1b43b84a9308f9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/cf 2023-10-06 16:00:54,407 DEBUG [StoreOpener-0a1cd66f8811f443c1b43b84a9308f9c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/cf 2023-10-06 16:00:54,406 DEBUG [StoreOpener-bb0da2a90d4894a9004cf3f0293199da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/cf 2023-10-06 16:00:54,407 INFO [StoreOpener-0a1cd66f8811f443c1b43b84a9308f9c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a1cd66f8811f443c1b43b84a9308f9c columnFamilyName cf 2023-10-06 16:00:54,407 INFO [StoreOpener-bb0da2a90d4894a9004cf3f0293199da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb0da2a90d4894a9004cf3f0293199da columnFamilyName cf 2023-10-06 16:00:54,408 INFO [StoreOpener-bb0da2a90d4894a9004cf3f0293199da-1] regionserver.HStore(310): Store=bb0da2a90d4894a9004cf3f0293199da/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 16:00:54,408 INFO [StoreOpener-0a1cd66f8811f443c1b43b84a9308f9c-1] regionserver.HStore(310): Store=0a1cd66f8811f443c1b43b84a9308f9c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-06 16:00:54,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:00:54,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:00:54,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:00:54,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:00:54,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:00:54,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:00:54,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 16:00:54,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-06 16:00:54,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb0da2a90d4894a9004cf3f0293199da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74639662, jitterRate=0.11221763491630554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 16:00:54,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb0da2a90d4894a9004cf3f0293199da: 2023-10-06 16:00:54,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a1cd66f8811f443c1b43b84a9308f9c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59190188, jitterRate=-0.11799746751785278}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-06 16:00:54,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a1cd66f8811f443c1b43b84a9308f9c: 2023-10-06 16:00:54,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da., pid=108, masterSystemTime=1696608054400 2023-10-06 16:00:54,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c., pid=109, masterSystemTime=1696608054400 2023-10-06 16:00:54,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:00:54,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:00:54,417 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=bb0da2a90d4894a9004cf3f0293199da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:54,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:54,417 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696608054417"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696608054417"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696608054417"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696608054417"}]},"ts":"1696608054417"} 2023-10-06 16:00:54,420 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=0a1cd66f8811f443c1b43b84a9308f9c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,420 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696608054420"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696608054420"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696608054420"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696608054420"}]},"ts":"1696608054420"} 2023-10-06 16:00:54,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-10-06 16:00:54,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure bb0da2a90d4894a9004cf3f0293199da, server=jenkins-hbase4.apache.org,32989,1696607957469 in 172 msec 2023-10-06 16:00:54,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-06 16:00:54,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 0a1cd66f8811f443c1b43b84a9308f9c, server=jenkins-hbase4.apache.org,36069,1696607957508 in 172 msec 2023-10-06 16:00:54,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb0da2a90d4894a9004cf3f0293199da, ASSIGN in 331 msec 2023-10-06 16:00:54,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-10-06 16:00:54,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a1cd66f8811f443c1b43b84a9308f9c, ASSIGN in 332 msec 2023-10-06 16:00:54,425 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-06 16:00:54,425 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608054425"}]},"ts":"1696608054425"} 2023-10-06 16:00:54,426 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-06 16:00:54,428 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-06 16:00:54,429 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-06 16:00:54,430 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-06 16:00:54,431 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:54,431 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:54,431 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:54,431 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:00:54,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:54,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:54,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:54,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-06 16:00:54,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 385 msec 2023-10-06 16:00:54,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-06 16:00:54,655 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-06 16:00:54,657 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,657 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:54,659 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 16:00:54,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 16:00:54,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696608054668 (current time:1696608054668). 2023-10-06 16:00:54,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 16:00:54,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x19e2729c to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:54,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24929c3b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:54,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:54,677 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:54,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19e2729c to 127.0.0.1:55741 2023-10-06 16:00:54,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:54,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x4238c83b to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:54,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48442472, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:54,686 DEBUG [hconnection-0x78071a05-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:54,688 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:54,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4238c83b to 127.0.0.1:55741 2023-10-06 16:00:54,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:54,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-06 16:00:54,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 16:00:54,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 16:00:54,696 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 16:00:54,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 16:00:54,698 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 16:00:54,699 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696608654699 2023-10-06 16:00:54,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 16:00:54,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,700 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 16:00:54,700 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 16:00:54,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 16:00:54,702 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 16:00:54,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-10-06 16:00:54,704 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 16:00:54,704 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696608654704 2023-10-06 16:00:54,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,716 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-06 16:00:54,716 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:54,718 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-06 16:00:54,718 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-06 16:00:54,718 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,718 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,719 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:54,719 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:54,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:54,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:54,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:54,719 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,719 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:54,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,720 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,720 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,721 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,721 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 16:00:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-06 16:00:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-06 16:00:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,721 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 16:00:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-06 16:00:54,721 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 16:00:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,721 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 16:00:54,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 16:00:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:54,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 16:00:54,722 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:54,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,724 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 16:00:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 16:00:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 16:00:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 16:00:54,726 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 16:00:54,726 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 16:00:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 16:00:54,726 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 16:00:54,726 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 16:00:54,726 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 16:00:54,738 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,738 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:54,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:54,738 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,738 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,739 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,739 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,739 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:54,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:54,739 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,739 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:54,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:54,739 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,739 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:54,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:54,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 16:00:54,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3aded115[Count = 1] remaining members to acquire global barrier 2023-10-06 16:00:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:54,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 16:00:54,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3aded115[Count = 0] remaining members to acquire global barrier 2023-10-06 16:00:54,743 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-06 16:00:54,743 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,744 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,744 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,745 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 16:00:54,745 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 16:00:54,744 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,745 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 16:00:54,745 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,745 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 16:00:54,745 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 16:00:54,745 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,745 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 16:00:54,745 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:54,745 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:54,745 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:54,745 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:54,746 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:00:54,746 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:54,746 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. started... 2023-10-06 16:00:54,746 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. started... 2023-10-06 16:00:54,747 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb0da2a90d4894a9004cf3f0293199da: 2023-10-06 16:00:54,747 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a1cd66f8811f443c1b43b84a9308f9c: 2023-10-06 16:00:54,747 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,748 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,748 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:54,748 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:54,748 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 16:00:54,748 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-06 16:00:54,748 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 16:00:54,748 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:54,748 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 16:00:54,769 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. completed. 2023-10-06 16:00:54,769 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:54,769 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:54,769 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:54,769 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,769 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 16:00:54,769 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 16:00:54,771 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,771 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 16:00:54,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:54,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:54,772 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. completed. 2023-10-06 16:00:54,772 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:54,772 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:00:54,772 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 16:00:54,774 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:54,774 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:54,774 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,774 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 16:00:54,774 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 16:00:54,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:54,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:54,776 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 16:00:54,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,776 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:54,776 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,776 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 16:00:54,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:54,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36069,1696607957508': 2023-10-06 16:00:54,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-06 16:00:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:54,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:54,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,32989,1696607957469': 2023-10-06 16:00:54,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-06 16:00:54,784 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-06 16:00:54,784 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 16:00:54,784 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 16:00:54,784 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,784 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 16:00:54,786 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,786 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,786 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:54,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,786 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,786 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:54,786 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:54,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,787 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,786 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:54,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:54,787 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,788 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,790 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:54,790 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,790 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:54,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:54,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:54,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:54,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:54,794 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:54,794 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:54,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:54,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:54,794 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,794 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:54,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,796 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 16:00:54,796 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:54,796 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:54,796 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,796 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-06 16:00:54,800 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:54,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 16:00:54,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-06 16:00:54,801 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 16:00:54,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,824 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-06 16:00:54,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,824 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:54,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696608054699Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696608054804 (+105 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696608054804Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696608054804Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696608054807 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696608054818 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696608054824 (+6 ms) 2023-10-06 16:00:54,827 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 16:00:54,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 127 msec 2023-10-06 16:00:55,001 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:55,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 16:00:55,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 16:00:55,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36069] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 16:00:55,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32989] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. with WAL disabled. Data may be lost in the event of a crash. 2023-10-06 16:00:55,009 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,009 DEBUG [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:55,009 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-06 16:00:55,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 16:00:55,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696608055018 (current time:1696608055018). 2023-10-06 16:00:55,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-06 16:00:55,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x788962db to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:55,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d0add67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:55,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:55,031 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:55,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x788962db to 127.0.0.1:55741 2023-10-06 16:00:55,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:55,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(139): Connect 0x1affba44 to 127.0.0.1:55741 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-06 16:00:55,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13843e09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-06 16:00:55,039 DEBUG [hconnection-0x7dbdf626-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-06 16:00:55,040 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-06 16:00:55,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1affba44 to 127.0.0.1:55741 2023-10-06 16:00:55,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:00:55,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-06 16:00:55,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-06 16:00:55,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 16:00:55,048 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot, current working dir path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor60.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-06 16:00:55,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 16:00:55,051 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 16:00:55,051 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696608655051 2023-10-06 16:00:55,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-06 16:00:55,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,052 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-06 16:00:55,052 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-06 16:00:55,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 16:00:55,054 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-06 16:00:55,054 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-10-06 16:00:55,055 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 16:00:55,056 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696608655056 2023-10-06 16:00:55,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,064 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-06 16:00:55,064 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:55,065 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-06 16:00:55,065 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-06 16:00:55,066 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,066 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,067 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:55,067 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:55,067 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:55,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:55,067 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:55,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:55,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:55,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:55,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:55,067 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,067 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,068 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,068 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 16:00:55,068 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-06 16:00:55,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,069 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 16:00:55,069 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 16:00:55,069 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:55,069 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:55,070 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 16:00:55,070 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 16:00:55,071 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 16:00:55,071 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41607,1696607957421' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 16:00:55,071 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 16:00:55,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,071 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 16:00:55,071 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-06 16:00:55,071 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-06 16:00:55,072 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-06 16:00:55,072 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-06 16:00:55,072 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-06 16:00:55,074 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,075 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,075 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,075 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,075 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:55,075 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:55,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:55,075 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,075 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,075 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:55,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:55,075 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,076 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-06 16:00:55,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:55,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:55,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32989,1696607957469' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 16:00:55,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fb07c16[Count = 1] remaining members to acquire global barrier 2023-10-06 16:00:55,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:55,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:55,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:55,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:55,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:55,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36069,1696607957508' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-06 16:00:55,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fb07c16[Count = 0] remaining members to acquire global barrier 2023-10-06 16:00:55,079 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-06 16:00:55,079 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,084 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,084 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,084 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,084 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 16:00:55,085 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,085 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 16:00:55,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,085 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 16:00:55,085 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-06 16:00:55,085 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41607,1696607957421' in zk 2023-10-06 16:00:55,085 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,085 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-06 16:00:55,085 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:55,085 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:55,085 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:00:55,085 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-06 16:00:55,085 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. started... 2023-10-06 16:00:55,085 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:55,085 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-06 16:00:55,085 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. started... 2023-10-06 16:00:55,085 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bb0da2a90d4894a9004cf3f0293199da 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-10-06 16:00:55,085 INFO [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a1cd66f8811f443c1b43b84a9308f9c 1/1 column families, dataSize=333 B heapSize=976 B 2023-10-06 16:00:55,086 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 16:00:55,087 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:55,087 DEBUG [member: 'jenkins-hbase4.apache.org,41607,1696607957421' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 16:00:55,102 INFO [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231006c4bbae2e7d7f47fa90d16ac70e383c81 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006c4bbae2e7d7f47fa90d16ac70e383c81 2023-10-06 16:00:55,102 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100685b250571b204509aba7290d81906820 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100685b250571b204509aba7290d81906820 2023-10-06 16:00:55,111 INFO [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/.tmp/cf/8d71b931a6804be39986dca312cb7d89 2023-10-06 16:00:55,111 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/.tmp/cf/2614dd28463e4440ac35073d5db552f5 2023-10-06 16:00:55,116 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/.tmp/cf/8d71b931a6804be39986dca312cb7d89 as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/cf/8d71b931a6804be39986dca312cb7d89 2023-10-06 16:00:55,116 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/.tmp/cf/2614dd28463e4440ac35073d5db552f5 as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/cf/2614dd28463e4440ac35073d5db552f5 2023-10-06 16:00:55,120 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/cf/2614dd28463e4440ac35073d5db552f5, entries=45, sequenceid=6, filesize=13.0 K 2023-10-06 16:00:55,120 INFO [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/cf/8d71b931a6804be39986dca312cb7d89, entries=5, sequenceid=6, filesize=5.8 K 2023-10-06 16:00:55,120 INFO [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for bb0da2a90d4894a9004cf3f0293199da in 35ms, sequenceid=6, compaction requested=false 2023-10-06 16:00:55,121 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-06 16:00:55,121 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb0da2a90d4894a9004cf3f0293199da: 2023-10-06 16:00:55,121 INFO [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 0a1cd66f8811f443c1b43b84a9308f9c in 36ms, sequenceid=6, compaction requested=false 2023-10-06 16:00:55,121 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,123 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a1cd66f8811f443c1b43b84a9308f9c: 2023-10-06 16:00:55,123 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:55,123 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/cf/2614dd28463e4440ac35073d5db552f5] hfiles 2023-10-06 16:00:55,123 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/cf/2614dd28463e4440ac35073d5db552f5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,123 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,123 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-06 16:00:55,123 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/cf/8d71b931a6804be39986dca312cb7d89] hfiles 2023-10-06 16:00:55,123 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/cf/8d71b931a6804be39986dca312cb7d89 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,130 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. completed. 2023-10-06 16:00:55,130 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. completed. 2023-10-06 16:00:55,130 DEBUG [rs(jenkins-hbase4.apache.org,32989,1696607957469)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:00:55,130 DEBUG [rs(jenkins-hbase4.apache.org,36069,1696607957508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:00:55,130 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:55,131 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-06 16:00:55,131 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:55,131 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,131 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-06 16:00:55,131 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 16:00:55,131 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,131 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36069,1696607957508' in zk 2023-10-06 16:00:55,131 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-06 16:00:55,131 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32989,1696607957469' in zk 2023-10-06 16:00:55,132 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,132 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 16:00:55,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:55,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:55,133 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:55,133 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,133 DEBUG [member: 'jenkins-hbase4.apache.org,32989,1696607957469' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 16:00:55,133 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-06 16:00:55,134 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:55,136 DEBUG [member: 'jenkins-hbase4.apache.org,36069,1696607957508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-06 16:00:55,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:55,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:55,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:55,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,32989,1696607957469': 2023-10-06 16:00:55,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32989,1696607957469' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-06 16:00:55,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:55,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:55,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36069,1696607957508': 2023-10-06 16:00:55,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36069,1696607957508' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-06 16:00:55,142 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-06 16:00:55,142 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-06 16:00:55,142 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-06 16:00:55,142 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,142 INFO [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-06 16:00:55,145 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,145 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,145 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:55,145 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,145 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-06 16:00:55,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-06 16:00:55,145 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:55,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,146 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,145 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-06 16:00:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:55,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:55,146 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,146 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-06 16:00:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,148 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-06 16:00:55,148 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,148 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,151 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,151 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,151 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,151 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:55,151 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:55,151 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,151 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-06 16:00:55,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:55,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:55,151 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:55,151 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,151 DEBUG [(jenkins-hbase4.apache.org,45793,1696607956151)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-06 16:00:55,151 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:55,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:55,151 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:55,153 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:00:55,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-06 16:00:55,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:55,151 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-06 16:00:55,153 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:55,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-06 16:00:55,153 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:55,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:55,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:55,151 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,153 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:00:55,154 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:00:55,154 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-06 16:00:55,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-06 16:00:55,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,154 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-06 16:00:55,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 16:00:55,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-06 16:00:55,154 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-06 16:00:55,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100685b250571b204509aba7290d81906820, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006c4bbae2e7d7f47fa90d16ac70e383c81] mob files 2023-10-06 16:00:55,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100685b250571b204509aba7290d81906820 2023-10-06 16:00:55,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006c4bbae2e7d7f47fa90d16ac70e383c81 2023-10-06 16:00:55,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,177 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-06 16:00:55,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,177 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696608055051Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696608055161 (+110 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696608055161Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696608055162 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696608055164 (+2 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696608055171 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696608055177 (+6 ms) 2023-10-06 16:00:55,180 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-06 16:00:55,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 128 msec 2023-10-06 16:00:55,355 DEBUG [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-06 16:00:55,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-06 16:00:55,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-06 16:00:55,356 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608055356 2023-10-06 16:00:55,356 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34141, tgtDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608055356, rawTgtDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608055356, srcFsUri=hdfs://localhost:34141, srcDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 16:00:55,378 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca 2023-10-06 16:00:55,378 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1375214160_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608055356, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608055356/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,378 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34141, inputRoot=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca, snapshotDir=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-06 16:00:55,389 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608055356/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:00:55,408 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,409 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,409 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,410 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,410 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,410 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,410 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,477 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/hadoop-4836427551705210675.jar 2023-10-06 16:00:55,478 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,478 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,479 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,479 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,479 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,479 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-06 16:00:55,480 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.5/hbase-shaded-miscellaneous-4.1.5.jar 2023-10-06 16:00:55,480 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.5/hbase-shaded-gson-4.1.5.jar 2023-10-06 16:00:55,480 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.5/hbase-shaded-protobuf-4.1.5.jar 2023-10-06 16:00:55,481 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.5/hbase-shaded-netty-4.1.5.jar 2023-10-06 16:00:55,481 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.5/hbase-unsafe-4.1.5.jar 2023-10-06 16:00:55,481 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-06 16:00:55,482 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-06 16:00:55,482 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-06 16:00:55,482 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-06 16:00:55,483 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-06 16:00:55,483 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:55,483 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:55,484 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:55,484 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:55,484 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-06 16:00:55,484 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:55,485 DEBUG [Listener at jenkins-hbase4.apache.org/39073] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-06 16:00:55,853 WARN [Listener at jenkins-hbase4.apache.org/39073] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-06 16:00:55,855 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-06 16:00:55,858 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-06 16:00:58,614 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 16:00:58,614 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-06 16:00:58,620 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0006_000001 (auth:SIMPLE) 2023-10-06 16:00:59,322 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 16:00:59,559 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0007_000001 (auth:SIMPLE) 2023-10-06 16:01:03,132 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0007_000001 (auth:SIMPLE) 2023-10-06 16:01:05,329 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0007_000001 (auth:SIMPLE) 2023-10-06 16:01:07,872 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696607963643_0007_000001 (auth:SIMPLE) 2023-10-06 16:01:09,031 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-06 16:01:09,031 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-06 16:01:09,042 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,042 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-06 16:01:09,043 INFO [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-06 16:01:09,043 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,043 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-06 16:01:09,043 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-06 16:01:09,043 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1929154419_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608055356/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608055356/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,044 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608055356/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-06 16:01:09,044 DEBUG [Listener at jenkins-hbase4.apache.org/39073] snapshot.TestExportSnapshot(367): hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/export-test/export-1696608055356/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-06 16:01:09,049 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-06 16:01:09,054 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608069054"}]},"ts":"1696608069054"} 2023-10-06 16:01:09,055 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-06 16:01:09,057 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-06 16:01:09,057 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a1cd66f8811f443c1b43b84a9308f9c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb0da2a90d4894a9004cf3f0293199da, UNASSIGN}] 2023-10-06 16:01:09,059 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a1cd66f8811f443c1b43b84a9308f9c, UNASSIGN 2023-10-06 16:01:09,059 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb0da2a90d4894a9004cf3f0293199da, UNASSIGN 2023-10-06 16:01:09,059 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=0a1cd66f8811f443c1b43b84a9308f9c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:01:09,060 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=bb0da2a90d4894a9004cf3f0293199da, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:01:09,060 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696608069059"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608069059"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608069059"}]},"ts":"1696608069059"} 2023-10-06 16:01:09,060 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696608069060"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696608069060"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696608069060"}]},"ts":"1696608069060"} 2023-10-06 16:01:09,061 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 0a1cd66f8811f443c1b43b84a9308f9c, server=jenkins-hbase4.apache.org,36069,1696607957508}] 2023-10-06 16:01:09,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure bb0da2a90d4894a9004cf3f0293199da, server=jenkins-hbase4.apache.org,32989,1696607957469}] 2023-10-06 16:01:09,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-06 16:01:09,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:01:09,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:01:09,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a1cd66f8811f443c1b43b84a9308f9c, disabling compactions & flushes 2023-10-06 16:01:09,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb0da2a90d4894a9004cf3f0293199da, disabling compactions & flushes 2023-10-06 16:01:09,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:01:09,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:01:09,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:01:09,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:01:09,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. after waiting 0 ms 2023-10-06 16:01:09,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. after waiting 0 ms 2023-10-06 16:01:09,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:01:09,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:01:09,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 16:01:09,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 16:01:09,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:01:09,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:01:09,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da. 2023-10-06 16:01:09,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c. 2023-10-06 16:01:09,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb0da2a90d4894a9004cf3f0293199da: 2023-10-06 16:01:09,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a1cd66f8811f443c1b43b84a9308f9c: 2023-10-06 16:01:09,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:01:09,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=bb0da2a90d4894a9004cf3f0293199da, regionState=CLOSED 2023-10-06 16:01:09,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696608069227"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608069227"}]},"ts":"1696608069227"} 2023-10-06 16:01:09,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:01:09,228 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=0a1cd66f8811f443c1b43b84a9308f9c, regionState=CLOSED 2023-10-06 16:01:09,228 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696608069227"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696608069227"}]},"ts":"1696608069227"} 2023-10-06 16:01:09,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-06 16:01:09,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure bb0da2a90d4894a9004cf3f0293199da, server=jenkins-hbase4.apache.org,32989,1696607957469 in 167 msec 2023-10-06 16:01:09,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-06 16:01:09,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 0a1cd66f8811f443c1b43b84a9308f9c, server=jenkins-hbase4.apache.org,36069,1696607957508 in 168 msec 2023-10-06 16:01:09,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb0da2a90d4894a9004cf3f0293199da, UNASSIGN in 173 msec 2023-10-06 16:01:09,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-10-06 16:01:09,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0a1cd66f8811f443c1b43b84a9308f9c, UNASSIGN in 174 msec 2023-10-06 16:01:09,233 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696608069233"}]},"ts":"1696608069233"} 2023-10-06 16:01:09,234 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-06 16:01:09,235 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-06 16:01:09,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 186 msec 2023-10-06 16:01:09,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-06 16:01:09,355 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-06 16:01:09,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,359 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,359 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,361 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41607] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,363 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:01:09,363 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:01:09,364 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,364 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,364 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,364 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,364 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-06 16:01:09,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-06 16:01:09,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-06 16:01:09,364 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-06 16:01:09,365 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/recovered.edits] 2023-10-06 16:01:09,365 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/cf, FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/recovered.edits] 2023-10-06 16:01:09,366 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,366 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:01:09,366 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,366 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:01:09,366 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,366 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:01:09,366 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,366 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-06 16:01:09,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-06 16:01:09,369 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/cf/8d71b931a6804be39986dca312cb7d89 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/cf/8d71b931a6804be39986dca312cb7d89 2023-10-06 16:01:09,370 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/cf/2614dd28463e4440ac35073d5db552f5 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/cf/2614dd28463e4440ac35073d5db552f5 2023-10-06 16:01:09,372 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da/recovered.edits/9.seqid 2023-10-06 16:01:09,372 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/recovered.edits/9.seqid to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c/recovered.edits/9.seqid 2023-10-06 16:01:09,373 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb0da2a90d4894a9004cf3f0293199da 2023-10-06 16:01:09,373 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0a1cd66f8811f443c1b43b84a9308f9c 2023-10-06 16:01:09,373 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-06 16:01:09,373 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-06 16:01:09,374 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-06 16:01:09,377 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100685b250571b204509aba7290d81906820 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100685b250571b204509aba7290d81906820 2023-10-06 16:01:09,378 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006c4bbae2e7d7f47fa90d16ac70e383c81 to hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20231006c4bbae2e7d7f47fa90d16ac70e383c81 2023-10-06 16:01:09,378 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-06 16:01:09,380 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,382 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-06 16:01:09,383 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-06 16:01:09,384 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,384 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-06 16:01:09,384 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696608069384"}]},"ts":"9223372036854775807"} 2023-10-06 16:01:09,384 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696608069384"}]},"ts":"9223372036854775807"} 2023-10-06 16:01:09,386 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-06 16:01:09,386 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0a1cd66f8811f443c1b43b84a9308f9c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696608054047.0a1cd66f8811f443c1b43b84a9308f9c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bb0da2a90d4894a9004cf3f0293199da, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696608054047.bb0da2a90d4894a9004cf3f0293199da.', STARTKEY => '1', ENDKEY => ''}] 2023-10-06 16:01:09,386 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-06 16:01:09,386 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696608069386"}]},"ts":"9223372036854775807"} 2023-10-06 16:01:09,387 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-06 16:01:09,389 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 33 msec 2023-10-06 16:01:09,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-06 16:01:09,468 INFO [Listener at jenkins-hbase4.apache.org/39073] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-06 16:01:09,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-06 16:01:09,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-06 16:01:09,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45793] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-06 16:01:09,502 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=910 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 259), ProcessCount=167 (was 167), AvailableMemoryMB=2135 (was 2218) 2023-10-06 16:01:09,502 WARN [Listener at jenkins-hbase4.apache.org/39073] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-06 16:01:09,502 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-06 16:01:09,511 INFO [Listener at jenkins-hbase4.apache.org/39073] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-06 16:01:09,622 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696607963643_0007_01_000001 is : 143 2023-10-06 16:01:14,795 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-06 16:01:23,637 INFO [Listener at jenkins-hbase4.apache.org/39073] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-06 16:01:37,755 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-06 16:01:37,756 INFO [Listener at jenkins-hbase4.apache.org/39073] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-06 16:01:37,866 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-06 16:01:37,878 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-06 16:01:37,879 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-06 16:01:37,887 INFO [Listener at jenkins-hbase4.apache.org/39073] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-06 16:01:37,991 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-06 16:01:37,991 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-06 16:01:37,991 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-06 16:01:37,991 INFO [Listener at jenkins-hbase4.apache.org/39073] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-06 16:01:37,991 DEBUG [Listener at jenkins-hbase4.apache.org/39073] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x292a7714 to 127.0.0.1:55741 2023-10-06 16:01:37,991 DEBUG [Listener at jenkins-hbase4.apache.org/39073] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:01:37,991 DEBUG [Listener at jenkins-hbase4.apache.org/39073] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-06 16:01:37,992 DEBUG [Listener at jenkins-hbase4.apache.org/39073] util.JVMClusterUtil(257): Found active master hash=213246523, stopped=false 2023-10-06 16:01:37,992 DEBUG [Listener at jenkins-hbase4.apache.org/39073] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:01:37,992 DEBUG [Listener at jenkins-hbase4.apache.org/39073] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-06 16:01:37,992 INFO [Listener at jenkins-hbase4.apache.org/39073] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45793,1696607956151 2023-10-06 16:01:37,993 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 16:01:37,994 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 16:01:37,994 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 16:01:37,994 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-06 16:01:37,994 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 16:01:37,994 INFO [Listener at jenkins-hbase4.apache.org/39073] procedure2.ProcedureExecutor(628): Stopping 2023-10-06 16:01:37,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 16:01:37,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 16:01:37,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 16:01:37,994 DEBUG [Listener at jenkins-hbase4.apache.org/39073] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a8e6b12 to 127.0.0.1:55741 2023-10-06 16:01:37,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-06 16:01:37,994 DEBUG [Listener at jenkins-hbase4.apache.org/39073] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:01:37,994 INFO [Listener at jenkins-hbase4.apache.org/39073] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41607,1696607957421' ***** 2023-10-06 16:01:37,995 DEBUG [Listener at jenkins-hbase4.apache.org/39073] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:01:37,995 INFO [Listener at jenkins-hbase4.apache.org/39073] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-06 16:01:37,995 INFO [Listener at jenkins-hbase4.apache.org/39073] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,32989,1696607957469' ***** 2023-10-06 16:01:37,995 DEBUG [Listener at jenkins-hbase4.apache.org/39073] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:01:37,995 INFO [Listener at jenkins-hbase4.apache.org/39073] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-06 16:01:37,995 INFO [RS:0;jenkins-hbase4:41607] regionserver.HeapMemoryManager(220): Stopping 2023-10-06 16:01:37,995 INFO [Listener at jenkins-hbase4.apache.org/39073] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36069,1696607957508' ***** 2023-10-06 16:01:37,995 INFO [RS:1;jenkins-hbase4:32989] regionserver.HeapMemoryManager(220): Stopping 2023-10-06 16:01:37,995 INFO [RS:0;jenkins-hbase4:41607] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-06 16:01:37,995 INFO [RS:1;jenkins-hbase4:32989] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-06 16:01:37,995 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-06 16:01:37,995 INFO [RS:1;jenkins-hbase4:32989] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-06 16:01:37,995 DEBUG [Listener at jenkins-hbase4.apache.org/39073] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:01:37,995 INFO [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:01:37,995 INFO [RS:0;jenkins-hbase4:41607] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-06 16:01:37,996 DEBUG [RS:1;jenkins-hbase4:32989] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x605b14de to 127.0.0.1:55741 2023-10-06 16:01:37,995 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-06 16:01:37,996 DEBUG [RS:1;jenkins-hbase4:32989] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:01:37,995 INFO [Listener at jenkins-hbase4.apache.org/39073] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-06 16:01:37,997 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-06 16:01:37,997 INFO [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,32989,1696607957469; all regions closed. 2023-10-06 16:01:37,997 INFO [RS:2;jenkins-hbase4:36069] regionserver.HeapMemoryManager(220): Stopping 2023-10-06 16:01:37,997 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(3305): Received CLOSE for 2f860cffc116916f00598211b87aaf8a 2023-10-06 16:01:37,997 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-06 16:01:37,997 INFO [RS:2;jenkins-hbase4:36069] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-06 16:01:37,997 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-06 16:01:37,998 INFO [RS:2;jenkins-hbase4:36069] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-06 16:01:37,998 INFO [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:01:37,998 DEBUG [RS:2;jenkins-hbase4:36069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4af6fd2a to 127.0.0.1:55741 2023-10-06 16:01:37,998 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(3305): Received CLOSE for 286f21d97265c26f36f00f289a586742 2023-10-06 16:01:37,998 DEBUG [RS:2;jenkins-hbase4:36069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:01:37,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2f860cffc116916f00598211b87aaf8a, disabling compactions & flushes 2023-10-06 16:01:37,998 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:01:38,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 16:01:38,000 INFO [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36069,1696607957508; all regions closed. 2023-10-06 16:01:38,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 16:01:38,000 DEBUG [RS:0;jenkins-hbase4:41607] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b1d9efd to 127.0.0.1:55741 2023-10-06 16:01:38,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. after waiting 0 ms 2023-10-06 16:01:38,000 DEBUG [RS:0;jenkins-hbase4:41607] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:01:38,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 16:01:38,001 INFO [RS:0;jenkins-hbase4:41607] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-06 16:01:38,001 INFO [RS:0;jenkins-hbase4:41607] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-06 16:01:38,001 INFO [RS:0;jenkins-hbase4:41607] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-06 16:01:38,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2f860cffc116916f00598211b87aaf8a 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-06 16:01:38,001 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-06 16:01:38,001 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-10-06 16:01:38,001 DEBUG [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1478): Online Regions={2f860cffc116916f00598211b87aaf8a=hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a., 286f21d97265c26f36f00f289a586742=hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742., 1588230740=hbase:meta,,1.1588230740} 2023-10-06 16:01:38,001 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-06 16:01:38,002 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-06 16:01:38,002 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-06 16:01:38,002 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-06 16:01:38,002 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-06 16:01:38,003 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-06 16:01:38,003 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-06 16:01:38,003 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-06 16:01:38,003 DEBUG [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1504): Waiting on 1588230740, 286f21d97265c26f36f00f289a586742, 2f860cffc116916f00598211b87aaf8a 2023-10-06 16:01:38,016 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-06 16:01:38,016 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-06 16:01:38,016 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-06 16:01:38,044 DEBUG [RS:1;jenkins-hbase4:32989] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/oldWALs 2023-10-06 16:01:38,044 DEBUG [RS:2;jenkins-hbase4:36069] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/oldWALs 2023-10-06 16:01:38,044 INFO [RS:1;jenkins-hbase4:32989] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32989%2C1696607957469:(num 1696607959180) 2023-10-06 16:01:38,045 INFO [RS:2;jenkins-hbase4:36069] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36069%2C1696607957508:(num 1696607959181) 2023-10-06 16:01:38,045 DEBUG [RS:2;jenkins-hbase4:36069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:01:38,045 DEBUG [RS:1;jenkins-hbase4:32989] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:01:38,045 INFO [RS:2;jenkins-hbase4:36069] regionserver.LeaseManager(133): Closed leases 2023-10-06 16:01:38,045 INFO [RS:1;jenkins-hbase4:32989] regionserver.LeaseManager(133): Closed leases 2023-10-06 16:01:38,055 INFO [RS:2;jenkins-hbase4:36069] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-06 16:01:38,055 INFO [RS:1;jenkins-hbase4:32989] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-06 16:01:38,056 INFO [RS:1;jenkins-hbase4:32989] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-06 16:01:38,056 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 16:01:38,056 INFO [RS:1;jenkins-hbase4:32989] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-06 16:01:38,057 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 16:01:38,056 INFO [RS:2;jenkins-hbase4:36069] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-06 16:01:38,057 INFO [RS:1;jenkins-hbase4:32989] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-06 16:01:38,057 INFO [RS:2;jenkins-hbase4:36069] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-06 16:01:38,057 INFO [RS:2;jenkins-hbase4:36069] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-06 16:01:38,058 INFO [RS:2;jenkins-hbase4:36069] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36069 2023-10-06 16:01:38,060 INFO [RS:1;jenkins-hbase4:32989] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32989 2023-10-06 16:01:38,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a/.tmp/info/5034e0d6162c4f64830ea11cba7285fb 2023-10-06 16:01:38,062 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/.tmp/info/38e6398ca5994e0c85fcf390c3c41658 2023-10-06 16:01:38,065 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:01:38,065 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:01:38,065 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 16:01:38,065 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36069,1696607957508 2023-10-06 16:01:38,065 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 16:01:38,065 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 16:01:38,065 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 16:01:38,066 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:01:38,066 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:01:38,066 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36069,1696607957508] 2023-10-06 16:01:38,066 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32989,1696607957469 2023-10-06 16:01:38,066 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36069,1696607957508; numProcessing=1 2023-10-06 16:01:38,068 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38e6398ca5994e0c85fcf390c3c41658 2023-10-06 16:01:38,069 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36069,1696607957508 already deleted, retry=false 2023-10-06 16:01:38,069 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36069,1696607957508 expired; onlineServers=2 2023-10-06 16:01:38,069 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32989,1696607957469] 2023-10-06 16:01:38,069 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32989,1696607957469; numProcessing=2 2023-10-06 16:01:38,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a/.tmp/info/5034e0d6162c4f64830ea11cba7285fb as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a/info/5034e0d6162c4f64830ea11cba7285fb 2023-10-06 16:01:38,071 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32989,1696607957469 already deleted, retry=false 2023-10-06 16:01:38,071 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32989,1696607957469 expired; onlineServers=1 2023-10-06 16:01:38,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a/info/5034e0d6162c4f64830ea11cba7285fb, entries=2, sequenceid=6, filesize=4.8 K 2023-10-06 16:01:38,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2f860cffc116916f00598211b87aaf8a in 74ms, sequenceid=6, compaction requested=false 2023-10-06 16:01:38,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/.tmp/rep_barrier/952daafe30e245ef8fff82622bfb5811 2023-10-06 16:01:38,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/namespace/2f860cffc116916f00598211b87aaf8a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-06 16:01:38,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:01:38,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 16:01:38,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2f860cffc116916f00598211b87aaf8a: 2023-10-06 16:01:38,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696607959576.2f860cffc116916f00598211b87aaf8a. 2023-10-06 16:01:38,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 286f21d97265c26f36f00f289a586742, disabling compactions & flushes 2023-10-06 16:01:38,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 16:01:38,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 16:01:38,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. after waiting 0 ms 2023-10-06 16:01:38,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 16:01:38,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 286f21d97265c26f36f00f289a586742 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-06 16:01:38,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 952daafe30e245ef8fff82622bfb5811 2023-10-06 16:01:38,097 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/.tmp/table/531e9aacf21c42dc891ce3fe3b34267b 2023-10-06 16:01:38,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/acl/286f21d97265c26f36f00f289a586742/.tmp/l/9643dd5df4a34ee2b0229b599c2c0e77 2023-10-06 16:01:38,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 531e9aacf21c42dc891ce3fe3b34267b 2023-10-06 16:01:38,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9643dd5df4a34ee2b0229b599c2c0e77 2023-10-06 16:01:38,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/.tmp/info/38e6398ca5994e0c85fcf390c3c41658 as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/info/38e6398ca5994e0c85fcf390c3c41658 2023-10-06 16:01:38,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/acl/286f21d97265c26f36f00f289a586742/.tmp/l/9643dd5df4a34ee2b0229b599c2c0e77 as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/acl/286f21d97265c26f36f00f289a586742/l/9643dd5df4a34ee2b0229b599c2c0e77 2023-10-06 16:01:38,106 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38e6398ca5994e0c85fcf390c3c41658 2023-10-06 16:01:38,106 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/info/38e6398ca5994e0c85fcf390c3c41658, entries=48, sequenceid=131, filesize=10.3 K 2023-10-06 16:01:38,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9643dd5df4a34ee2b0229b599c2c0e77 2023-10-06 16:01:38,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/acl/286f21d97265c26f36f00f289a586742/l/9643dd5df4a34ee2b0229b599c2c0e77, entries=7, sequenceid=18, filesize=5.2 K 2023-10-06 16:01:38,107 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/.tmp/rep_barrier/952daafe30e245ef8fff82622bfb5811 as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/rep_barrier/952daafe30e245ef8fff82622bfb5811 2023-10-06 16:01:38,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 286f21d97265c26f36f00f289a586742 in 24ms, sequenceid=18, compaction requested=false 2023-10-06 16:01:38,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/acl/286f21d97265c26f36f00f289a586742/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-06 16:01:38,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 952daafe30e245ef8fff82622bfb5811 2023-10-06 16:01:38,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:01:38,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/rep_barrier/952daafe30e245ef8fff82622bfb5811, entries=13, sequenceid=131, filesize=6.4 K 2023-10-06 16:01:38,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 16:01:38,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 286f21d97265c26f36f00f289a586742: 2023-10-06 16:01:38,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696607960314.286f21d97265c26f36f00f289a586742. 2023-10-06 16:01:38,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/.tmp/table/531e9aacf21c42dc891ce3fe3b34267b as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/table/531e9aacf21c42dc891ce3fe3b34267b 2023-10-06 16:01:38,119 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 531e9aacf21c42dc891ce3fe3b34267b 2023-10-06 16:01:38,119 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/table/531e9aacf21c42dc891ce3fe3b34267b, entries=24, sequenceid=131, filesize=6.9 K 2023-10-06 16:01:38,120 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 117ms, sequenceid=131, compaction requested=false 2023-10-06 16:01:38,132 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-06 16:01:38,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-06 16:01:38,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-06 16:01:38,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-06 16:01:38,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-06 16:01:38,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-06 16:01:38,167 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 16:01:38,167 INFO [RS:2;jenkins-hbase4:36069] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36069,1696607957508; zookeeper connection closed. 2023-10-06 16:01:38,168 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:36069-0x1011c7620dc0003, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 16:01:38,168 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@115f5487] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@115f5487 2023-10-06 16:01:38,203 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41607,1696607957421; all regions closed. 2023-10-06 16:01:38,210 DEBUG [RS:0;jenkins-hbase4:41607] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/oldWALs 2023-10-06 16:01:38,210 INFO [RS:0;jenkins-hbase4:41607] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41607%2C1696607957421.meta:.meta(num 1696607959293) 2023-10-06 16:01:38,215 DEBUG [RS:0;jenkins-hbase4:41607] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/oldWALs 2023-10-06 16:01:38,215 INFO [RS:0;jenkins-hbase4:41607] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41607%2C1696607957421:(num 1696607959180) 2023-10-06 16:01:38,215 DEBUG [RS:0;jenkins-hbase4:41607] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:01:38,215 INFO [RS:0;jenkins-hbase4:41607] regionserver.LeaseManager(133): Closed leases 2023-10-06 16:01:38,215 INFO [RS:0;jenkins-hbase4:41607] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-06 16:01:38,215 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 16:01:38,216 INFO [RS:0;jenkins-hbase4:41607] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41607 2023-10-06 16:01:38,219 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41607,1696607957421 2023-10-06 16:01:38,219 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-06 16:01:38,223 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41607,1696607957421] 2023-10-06 16:01:38,223 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41607,1696607957421; numProcessing=3 2023-10-06 16:01:38,226 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41607,1696607957421 already deleted, retry=false 2023-10-06 16:01:38,226 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41607,1696607957421 expired; onlineServers=0 2023-10-06 16:01:38,226 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45793,1696607956151' ***** 2023-10-06 16:01:38,226 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-06 16:01:38,226 DEBUG [M:0;jenkins-hbase4:45793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d88e800, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-06 16:01:38,226 INFO [M:0;jenkins-hbase4:45793] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45793,1696607956151 2023-10-06 16:01:38,226 INFO [M:0;jenkins-hbase4:45793] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45793,1696607956151; all regions closed. 2023-10-06 16:01:38,226 DEBUG [M:0;jenkins-hbase4:45793] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-06 16:01:38,226 DEBUG [M:0;jenkins-hbase4:45793] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-06 16:01:38,226 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-06 16:01:38,227 DEBUG [M:0;jenkins-hbase4:45793] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-06 16:01:38,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696607958755] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696607958755,5,FailOnTimeoutGroup] 2023-10-06 16:01:38,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696607958757] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696607958757,5,FailOnTimeoutGroup] 2023-10-06 16:01:38,227 INFO [M:0;jenkins-hbase4:45793] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-06 16:01:38,227 INFO [M:0;jenkins-hbase4:45793] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-06 16:01:38,227 INFO [M:0;jenkins-hbase4:45793] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-06 16:01:38,227 DEBUG [M:0;jenkins-hbase4:45793] master.HMaster(1512): Stopping service threads 2023-10-06 16:01:38,227 INFO [M:0;jenkins-hbase4:45793] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-06 16:01:38,227 ERROR [M:0;jenkins-hbase4:45793] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-10-06 16:01:38,228 INFO [M:0;jenkins-hbase4:45793] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-06 16:01:38,228 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-06 16:01:38,229 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-06 16:01:38,229 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-06 16:01:38,229 DEBUG [M:0;jenkins-hbase4:45793] zookeeper.ZKUtil(398): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-06 16:01:38,229 WARN [M:0;jenkins-hbase4:45793] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-06 16:01:38,229 INFO [M:0;jenkins-hbase4:45793] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-06 16:01:38,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-06 16:01:38,229 INFO [M:0;jenkins-hbase4:45793] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-06 16:01:38,230 DEBUG [M:0;jenkins-hbase4:45793] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-06 16:01:38,230 INFO [M:0;jenkins-hbase4:45793] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 16:01:38,230 DEBUG [M:0;jenkins-hbase4:45793] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 16:01:38,230 DEBUG [M:0;jenkins-hbase4:45793] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-06 16:01:38,230 DEBUG [M:0;jenkins-hbase4:45793] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 16:01:38,230 INFO [M:0;jenkins-hbase4:45793] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.93 KB heapSize=452.20 KB 2023-10-06 16:01:38,243 INFO [M:0;jenkins-hbase4:45793] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.93 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f7fb2b91129b444eb345b7ff1e6a610f 2023-10-06 16:01:38,247 INFO [M:0;jenkins-hbase4:45793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7fb2b91129b444eb345b7ff1e6a610f 2023-10-06 16:01:38,248 DEBUG [M:0;jenkins-hbase4:45793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f7fb2b91129b444eb345b7ff1e6a610f as hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f7fb2b91129b444eb345b7ff1e6a610f 2023-10-06 16:01:38,252 INFO [M:0;jenkins-hbase4:45793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7fb2b91129b444eb345b7ff1e6a610f 2023-10-06 16:01:38,252 INFO [M:0;jenkins-hbase4:45793] regionserver.HStore(1080): Added hdfs://localhost:34141/user/jenkins/test-data/7d28eb52-87b0-239b-0f27-ab48ac6427ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f7fb2b91129b444eb345b7ff1e6a610f, entries=119, sequenceid=899, filesize=28.7 K 2023-10-06 16:01:38,252 INFO [M:0;jenkins-hbase4:45793] regionserver.HRegion(2948): Finished flush of dataSize ~375.93 KB/384949, heapSize ~452.19 KB/463040, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=899, compaction requested=false 2023-10-06 16:01:38,254 INFO [M:0;jenkins-hbase4:45793] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-06 16:01:38,254 DEBUG [M:0;jenkins-hbase4:45793] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-06 16:01:38,257 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-06 16:01:38,257 INFO [M:0;jenkins-hbase4:45793] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-06 16:01:38,258 INFO [M:0;jenkins-hbase4:45793] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45793 2023-10-06 16:01:38,260 DEBUG [M:0;jenkins-hbase4:45793] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45793,1696607956151 already deleted, retry=false 2023-10-06 16:01:38,268 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 16:01:38,268 INFO [RS:1;jenkins-hbase4:32989] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,32989,1696607957469; zookeeper connection closed. 2023-10-06 16:01:38,268 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:32989-0x1011c7620dc0002, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 16:01:38,268 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5def68bf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5def68bf 2023-10-06 16:01:38,368 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 16:01:38,368 INFO [M:0;jenkins-hbase4:45793] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45793,1696607956151; zookeeper connection closed. 2023-10-06 16:01:38,368 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): master:45793-0x1011c7620dc0000, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 16:01:38,468 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 16:01:38,468 INFO [RS:0;jenkins-hbase4:41607] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41607,1696607957421; zookeeper connection closed. 2023-10-06 16:01:38,468 DEBUG [Listener at localhost/36163-EventThread] zookeeper.ZKWatcher(600): regionserver:41607-0x1011c7620dc0001, quorum=127.0.0.1:55741, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-06 16:01:38,468 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3948323c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3948323c 2023-10-06 16:01:38,469 INFO [Listener at jenkins-hbase4.apache.org/39073] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-06 16:01:38,469 WARN [Listener at jenkins-hbase4.apache.org/39073] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-06 16:01:38,472 INFO [Listener at jenkins-hbase4.apache.org/39073] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 16:01:38,575 WARN [BP-1064057539-172.31.14.131-1696607952900 heartbeating to localhost/127.0.0.1:34141] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-06 16:01:38,575 WARN [BP-1064057539-172.31.14.131-1696607952900 heartbeating to localhost/127.0.0.1:34141] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1064057539-172.31.14.131-1696607952900 (Datanode Uuid 4f14dbc4-ee2f-4668-8971-4da1685c7bb0) service to localhost/127.0.0.1:34141 2023-10-06 16:01:38,577 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data5/current/BP-1064057539-172.31.14.131-1696607952900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 16:01:38,577 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data6/current/BP-1064057539-172.31.14.131-1696607952900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 16:01:38,578 WARN [Listener at jenkins-hbase4.apache.org/39073] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-06 16:01:38,580 INFO [Listener at jenkins-hbase4.apache.org/39073] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 16:01:38,683 WARN [BP-1064057539-172.31.14.131-1696607952900 heartbeating to localhost/127.0.0.1:34141] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-06 16:01:38,683 WARN [BP-1064057539-172.31.14.131-1696607952900 heartbeating to localhost/127.0.0.1:34141] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1064057539-172.31.14.131-1696607952900 (Datanode Uuid f32acbac-f466-4e80-b785-c97900bf7495) service to localhost/127.0.0.1:34141 2023-10-06 16:01:38,684 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data3/current/BP-1064057539-172.31.14.131-1696607952900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 16:01:38,684 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data4/current/BP-1064057539-172.31.14.131-1696607952900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 16:01:38,684 WARN [Listener at jenkins-hbase4.apache.org/39073] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-06 16:01:38,686 INFO [Listener at jenkins-hbase4.apache.org/39073] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 16:01:38,789 WARN [BP-1064057539-172.31.14.131-1696607952900 heartbeating to localhost/127.0.0.1:34141] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-06 16:01:38,789 WARN [BP-1064057539-172.31.14.131-1696607952900 heartbeating to localhost/127.0.0.1:34141] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1064057539-172.31.14.131-1696607952900 (Datanode Uuid 831954e8-7f85-425c-9257-95272c47a4cb) service to localhost/127.0.0.1:34141 2023-10-06 16:01:38,790 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data1/current/BP-1064057539-172.31.14.131-1696607952900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 16:01:38,790 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dd675988-1c11-1c01-176b-27b4b471fd49/cluster_3eb83682-d593-847b-b6e3-3c39a32359e2/dfs/data/data2/current/BP-1064057539-172.31.14.131-1696607952900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-06 16:01:38,811 INFO [Listener at jenkins-hbase4.apache.org/39073] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-06 16:01:38,937 INFO [Listener at jenkins-hbase4.apache.org/39073] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-06 16:01:39,026 INFO [Listener at jenkins-hbase4.apache.org/39073] hbase.HBaseTestingUtility(1293): Minicluster is down